How can I get the MapReduce Jobs source codes gene

2020-02-29 03:35发布

问题:

I'd like to know what is the code generated by the compiler of SQL Hive ( i.e. if I execute one sql sentence I'd like to see the code of MapReduce jobs generated by compiler of SQL hive).

How can I get it?

回答1:

For Hive, it serializes the physical plan into an xml file (page 15 in http://www.slideshare.net/nzhang/hive-anatomy). So, I do not think that users can get the real source codes for hadoop. To get the code, you can try YSmart (http://ysmart.cse.ohio-state.edu/). It is a translator that will translate your sql queries to the java source code for hadoop. You can use the online version of the YSmart. Just submit the schema and your query, you will be able to view and download the java code.



标签: hadoop hive