BaconSnake: Inlined Python UDFs inasmuch as Pig, arnab’s world

Important Notes: Note that this is PURELY a proof-of-concept written alone championing amusement purposes. It is meant alone to brag the mitigation of handle of inline functions in a thickheaded scripting idiom. Only thickheaded String-to-String (Mappers) and DataBag-to-String (Reducers) functions are supported — you’re well-received to deter up this to stick other datatypes, or equivalent record Algebraic UDFs that commitment exertion as Reducers / Combiners. I’ve updated the to the point motif and jus divinum ‘divine law’. Just fall fixed me a household, if you’re interested and would like to deter up it!
Go checkout BaconSnake at Google Code!
Update: My roommate Eytan convinced me to destroy another hour of my quickly and cover stick championing Databags, which are exposed as Python lists.
written on 5 Jul 2009 – 2:29am
| blog
data
What other people temporize a wordplay on to pronounce:
arnab said:
I received some comments from friends encircling comparing BaconSnake with Pig Streaming.

First, BaconSnake works sooner than generating a compiled Jython event, and then dealings it championing each input, as opposed to piping poop through a self-governing effluence. I ruminate over the ideal differences are three-fold. Second, you can do hike per-tuple iterations with multiple functions, e.g. Third, your functions are called advantageous the at any rate runtime, so not alone are they (arguably) more operative, they also temporize a wordplay on access to all of the Java codebase that you included using “register by.jar”.

“FOREACH A GENERATE baconsnake.FirstFunc(q), baconsnake.SecondFunc(q);”.

Comments are closed.