Topic: mapreduce

donnemartin / data-science-ipython-notebooks

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spar…

python machine-learning deep-learning data-science big-data aws tensorflow theano caffe scikit-learn kaggle spark mapreduce hadoop matplotlib pandas numpy scipy keras

Python Updated Feb 11, 2019 5 issues need help

redisson / redisson

8.4k

Redisson - distributed Java objects and services (Set, Multimap, SortedSet, Map, List, Queue, Deque, Semaphore, Lock,…

java redis lock map list queue executor redis-cluster redis-client distributed set distributed-locks tomcat hibernate cache scheduler mapreduce spring session

Java Updated Mar 22, 2019

douban / dpark

2.5k

Python clone of Spark, a MapReduce alike framework in Python

bigdata mapreduce dpark stream-processing spark python

Python Updated Jan 23, 2019

Microsoft / Mobius

895

C# and F# language binding and extensions to Apache Spark

spark apache-spark rdd dataframe dstream dataset streaming csharp mobius kafka-streaming spark-streaming fsharp bigdata mapreduce eventhubs near-real-time

C# Updated Dec 24, 2018

bcongdon / corral

600

🐎 A serverless MapReduce framework written for AWS Lambda

aws-lambda mapreduce-framework mapreduce serverless

Go Updated Mar 19, 2019

happyer / distributed-computing

343

distributed_computing include mapreduce kvstore etc.

raft mapreduce consistency

Go Updated Jun 26, 2017

cdapio / cdap

296

An open source framework for building data analytic applications.

unified integration platform dataset mapreduce spark spark-streaming java java-8 cdap python middleware

Java Updated Mar 22, 2019

DigitalPebble / behemoth

283

Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.

hadoop java nlp mapreduce

Java Updated Apr 25, 2018

CamDavidsonPilon / tdigest

192

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

python percentile quantile estimate pyspark distributed-computing mapreduce

Python Updated Nov 20, 2018

xingdl2007 / 6.824-2017

136

⚡️ 6.824: Distributed Systems (Spring 2017). A course which present abstractions and implementation techniques for e…

distributed-systems raft mapreduce key-value-store sharding-db

Go Updated May 29, 2018

asakusafw / asakusafw

113

Asakusa Framework

asakusa-framework batch batch-processing java hadoop mapreduce data-flow framework big-data

Java Updated Jan 16, 2019

miguno / avro-hadoop-starter

109

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

avro hadoop java mapreduce hive pig

Java Updated Nov 12, 2015

Refefer / Dampr

95

Python Data Processing library

dataflow batch-processing mapreduce machine-learning

Python Updated Jan 6, 2019

iflytek / Guitar

72

A Simple and Efficient Distributed Multidimensional BI Analysis Engine.

java mapreduce multidimensional business-intelligence reports data-analysis olap olap-cube

Java Updated May 2, 2018

andreaiacono / MapReduce

67

MapReduce by examples

mapreduce tutorial

Java Updated Oct 28, 2016

nellore / rail

65

Scalable RNA-seq analysis

rna-seq-analysis emr mapreduce alignments ipython rail-rna

Python Updated Mar 15, 2018

GoCollaborate / src

47

A light-weight distributed stream computing framework for Golang

golang go distributed-framework microservices mapreduce hadoop golang-library mattn

Go Updated May 15, 2018

maxis42 / Big-Data-Engineering-Coursera-Yandex

40

Big Data for Data Engineers Coursera Specialization from Yandex

big-data yandex coursera python hdfs spark mapreduce bigdata

Jupyter Notebook Updated Nov 20, 2018

yenkuanlee / IPDC

39

IPDC(InterPlanetary Distributed Computing) is the Distributed Computation service, A peer-to-peer hypermedia protocol…

ipfs mapreduce tensorflow edge-computing blockchain ethereum paho-mqtt

Python Updated May 7, 2018

kwartile / connected-component

37

Map Reduce Implementation of Connected Component on Apache Spark

connected-components apache-spark graphx scala mapreduce union-find graph-algorithms

Scala Updated Dec 15, 2018

flipkart-incubator / hbase-orm

36

An ORM library that helps you [1] read/write HBase rows in a clean way [2] write+test MapReduce jobs that read from a…

hbase orm mapreduce hadoop-mapreduce java-annotations object-mapping junit java-libraries column-family hbase-orm

Java Updated Dec 3, 2018

am-kantox / elixir-iteraptor

34

Handy enumerable operations implementation.

elixir elixir-lang iteration mapreduce

Elixir Updated Mar 15, 2019

jehiah / gomrjob

32

gomrjob - a Go Framework for Hadoop Map Reduce Jobs

hadoop mapreduce mrjob go dataproc

Go Updated Sep 21, 2018

azavea / terraform-aws-emr-cluster

23

A Terraform module to create an Amazon Web Services (AWS) Elastic MapReduce (EMR) cluster.

terraform terraform-modules aws amazon-web-services emr mapreduce

HCL Updated Feb 26, 2018

d2si-oss / ooso

19

Java library for running Serverless MapReduce jobs

aws lambda mapreduce java library serverless

Java Updated Aug 10, 2017

a4tunado / lectures-hse-spark

18

Масштабируемое машинное обучение и анализ больших данных с Apache Spark

spark mapreduce lectures machine-learning bigdata

Jupyter Notebook Updated Mar 11, 2018

sunnyandgood / BigData

17

💎

🔥大数据学习笔记

hadoop hive hbase hdfs zookeeper sqoop mapreduce flume mysql linux shell

Java Updated Mar 5, 2019

Lemonjing / HadoopDedup

17

🍉基于Hadoop和HBase的大规模海量数据去重

big-data dedup cdc fsp mapreduce

Java Updated Apr 8, 2018

TauferLab / Mimir

16

Mimir is a new implementation of MapReduce over MPI. Mimir inherits the core principles of existing MapReduce framewo…

high-performance-computing data-analytics mapreduce mpi memory-efficiency performance-and-scalability

C++ Updated Nov 12, 2018

hobbyquaker / mqttDB

14

JSON Store with MQTT Interface 📚

📂

📡

mqtt database json store mapreduce nosql documents metadata views

JavaScript Updated May 30, 2018

Please note that GitHub no longer supports Internet Explorer.

mapreduce

Repositories 636