Beginning Apache Pig [electronic resource] : Big Data Processing Made Easy /
Vaddeman, Balaswamy.author.
Learn to use Apache Pig to develop lightweight big data applications easily and quickly. This book shows you many optimization techniques and covers every context where Pig is used in big data analytics. Beginning Apache Pig shows you how Pig is easy to learn and requires relatively little time to develop big data applications. The book is divided into four parts: the complete features of Apache Pig; integration with other tools; how to solve complex business problems; and optimization of tools. You'll discover topics such as MapReduce and why it cannot meet every business need; the features of Pig Latin such as data types for each load, store, joins, groups, and ordering; how Pig workflows can be created; submitting Pig jobs using Hue; and working with Oozie. You'll also see how to extend the framework by writing UDFs and custom load, store, and filter functions. Finally you'll cover different optimization techniques such as gathering statistics about a Pig script, joining strategies, parallelism, and the role of data formats in good performance. What You Will Learn • Use all the features of Apache Pig • Integrate Apache Pig with other tools • Extend Apache Pig • Optimize Pig Latin code • Solve different use cases for Pig Latin Who This Book Is For All levels of IT professionals: architects, big data enthusiasts, engineers, developers, and big data administrators.
Includes index.
Chapter 1 - Introduction -- Chapter 2 - Data types -- Chapter 3 - Grunt -- Chapter 4 - Introduction to Pig Latin -- Chapter 5 - Joins and Functions -- Chapter 6 - Pig Latin using Oozie -- Chapter 7 - Introduction to HCatalog -- Chapter 8 - Submitting Pig jobs using Hue -- Chapter 9 - Role of Pig in Apache Falcon -- Chapter 10 - Macros -- Chapter 11 - User defined Functions -- Chapter 12 - Writing your own eval and Filter Functions -- Chapter 13 - Writing your own Load and Store Functions -- Chapter 14 - Know Your Pig latin scripts -- Chapter 15 - Data formats -- Chapter 16 - Optimization -- Chapter 17 - Other Hadoop tools -- Appendix A - Builtin Functions -- Appendix B - Apache Pig in Apache Ambari -- Appendix C - HBaseStorage and ORCSTorage options.
Learn to use Apache Pig to develop lightweight big data applications easily and quickly. This book shows you many optimization techniques and covers every context where Pig is used in big data analytics. Beginning Apache Pig shows you how Pig is easy to learn and requires relatively little time to develop big data applications. The book is divided into four parts: the complete features of Apache Pig; integration with other tools; how to solve complex business problems; and optimization of tools. You'll discover topics such as MapReduce and why it cannot meet every business need; the features of Pig Latin such as data types for each load, store, joins, groups, and ordering; how Pig workflows can be created; submitting Pig jobs using Hue; and working with Oozie. You'll also see how to extend the framework by writing UDFs and custom load, store, and filter functions. Finally you'll cover different optimization techniques such as gathering statistics about a Pig script, joining strategies, parallelism, and the role of data formats in good performance. What You Will Learn • Use all the features of Apache Pig • Integrate Apache Pig with other tools • Extend Apache Pig • Optimize Pig Latin code • Solve different use cases for Pig Latin Who This Book Is For All levels of IT professionals: architects, big data enthusiasts, engineers, developers, and big data administrators.
Open source software.
Computer programming.
Database management.
Data structures (Computer science).
Data mining.
Information storage and retrieval.
Open Source.
Database Management.
Data Storage Representation.
Data Mining and Knowledge Discovery.
Information Storage and Retrieval.