Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

4x99/diskqueue

Open more actions menu

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
23 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DiskQueue

Disk-based FIFO queue


Features

  • FIFO
  • High performance

Getting Started

go get -u github.com/4x99/diskqueue
package main

import (
	"fmt"
	"github.com/4x99/diskqueue"
	"log"
	"time"
)

func main() {
	var err error
	var queue *diskqueue.Diskqueue

	// config
	diskqueue.Config.Path = "/tmp/diskqueue"
	diskqueue.Config.BatchSize = 1

	// start
	if queue, err = diskqueue.Start(); err != nil {
		log.Fatalln(err)
	}

	// write
	go func() {
		for {
			time.Sleep(time.Second)
			data := []byte(time.Now().Format("2006-01-02 15:04:05"))
			if err := queue.Write(data); err != nil {
				fmt.Println(err)
			}
		}
	}()

	// read
	go func() {
		for {
			time.Sleep(time.Second)
			if index, offset, data, err := queue.Read(); err == nil {
				fmt.Println(index, offset, string(data))
				queue.Commit(index, offset) // commit
			}
		}
	}()

	select {}
}

Default Config

Config = &config{
	Path:              "data",
	FilePerm:          0600,
	BatchSize:         100,
	BatchTime:         time.Second,
	SegmentSize:       50 * 1024 * 1024,
	SegmentLimit:      2048,
	WriteTimeout       300,
	CheckpointFile:    ".checkpoint",
	MinRequiredSpace:  1024 * 1024 * 1024,
}

About

Disk-based FIFO queue

Resources

Stars

Watchers

Forks

Packages

 
 
 

Contributors

Languages

Morty Proxy This is a proxified and sanitized view of the page, visit original site.