Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

dfunc-serverless/WorkerNode-Python

Open more actions menu

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

60 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

WorkerNode


The worker node repository defines how workers are interacting with the scheduler component. The communication is supported by Google pubsub, a Google API allows message publication and subscription.

Features

  • Constantly listening to the job scheduler
  • Parallel jobs running in threads
  • Sufficiently fills up allocated resources with function jobs

Dependency

  • Docker
  • Google pubsub

Handling Secrete

  • By using Google API, dFunc has to expose restricted Google API keys to worker nodes. The API keys are shared among all workers and only allows subscription. All Google API keys will be saved inside the .config directory.

Usage

Running Worker node component only requires workers to run the main python function with valid JSON secrets.

Further Work

  • Package worker node into a docker image.
  • Connect with a GUI to allow registered user startup with one click.

About

Worker side application

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Contributors 2

  •  
  •  

Languages

Morty Proxy This is a proxified and sanitized view of the page, visit original site.