Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Beaver to kafka #424

Copy link
Copy link
@madiTG

Description

@madiTG
Issue body actions

Nothing is being written to kafka queue (it is being auto created). After some line appearing in log there is NoneType error from beaver daemon

python-2.7.12-2

print kafka.version
1.3.5

[beaver]
logstash_version: 1
transport: kafka
kafka_client_id: beaver-kafka-1
kafka_hosts: 10.151.23.10:9092,10.151.23.11:9092,10.151.23.12:9092
kafka_key: beaverrrr
kafka_topic: beaverrrr
kafka_batch_n: 10
kafka_batch_t: 10

[/app/my.log]

type: syslog
tags: nta02

kafka
0.11.0.1

[2018-01-31 15:00:10,281] INFO Starting worker...
[2018-01-31 15:00:10,292] INFO Starting queue consumer
[2018-01-31 15:00:10,297] INFO Working...
[2018-01-31 15:00:10,342] INFO [/app/my.log] - watching logfile
[2018-01-31 15:00:24,791] ERROR Exception caught sending message/s : 'NoneType' object is not callable
[2018-01-31 15:00:24,792] INFO Caught transport exception: Unspecified exception encountered
[2018-01-31 15:00:24,792] INFO Reconnecting in 3 seconds
[2018-01-31 15:00:27,851] ERROR Exception caught sending message/s : 'NoneType' object is not callable
[2018-01-31 15:00:27,851] INFO Caught transport exception: Unspecified exception encountered
[2018-01-31 15:00:27,851] INFO Reconnecting in 9 seconds
[2018-01-31 15:00:36,388] INFO SIGINT detected
[2018-01-31 15:00:36,389] INFO Shutting down. Please wait...
[2018-01-31 15:00:36,440] INFO SIGINT detected
[2018-01-31 15:00:36,441] INFO Shutting down. Please wait...
Process Process-1:
Traceback (most recent call last):
File "/opt/freeware/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/opt/freeware/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "/opt/freeware/lib/python2.7/site-packages/beaver/dispatcher/tail.py", line 83, in create_queue_producer
manager.run()
File "/opt/freeware/lib/python2.7/site-packages/beaver/worker/tail_manager.py", line 83, in run
time.sleep(interval)
File "/opt/freeware/lib/python2.7/site-packages/beaver/dispatcher/tail.py", line 51, in cleanup
manager_proc.terminate()
File "/opt/freeware/lib/python2.7/multiprocessing/process.py", line 137, in terminate
self._popen.terminate()
AttributeError: 'NoneType' object has no attribute 'terminate'
[2018-01-31 15:00:36,447] INFO Shutdown complete.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      Morty Proxy This is a proxified and sanitized view of the page, visit original site.