Skip to content Skip to sidebar Skip to footer
Showing posts with the label Mapreduce

Python Udfs In Pig

I've seen the documentatio here, but I confess that I feel it rather lacking. I was wondering … Read more Python Udfs In Pig

Running A Job Using Hadoop Streaming And Mrjob: Pipemapred.waitoutputthreads(): Subprocess Failed With Code 1

Hey I'm fairly new to the world of Big Data. I came across this tutorial on http://musicmachin… Read more Running A Job Using Hadoop Streaming And Mrjob: Pipemapred.waitoutputthreads(): Subprocess Failed With Code 1

Mapreduce In Pymongo

My Mongo collection : Impressions has docs in the following format:- { _uid: 10, … Read more Mapreduce In Pymongo

Appengine Mapreduce Ndb, Deadlineexceedederror

we're trying to heavily use MapReduce in our project. Now we have this problem, there is a lot… Read more Appengine Mapreduce Ndb, Deadlineexceedederror

Flatten A Dictionary Of Dictionaries (2 Levels Deep) Of Lists

I'm trying to wrap my brain around this but it's not flexible enough. In my Python script I… Read more Flatten A Dictionary Of Dictionaries (2 Levels Deep) Of Lists

Read Avro File Using Python

I have an AVRO file(created by JAVA) and seems like it is some kind of zipped file for hadoop/mapre… Read more Read Avro File Using Python