http://blog.boyangyue.com/tags/apache-hive/Recent content in Apache Hive on Boyang YueHugoen-usA Good Year AheadSun, 16 Jan 2022 21:46:37 +0800http://blog.boyangyue.com/2022/01/the-comprehensive-guide-to-hive-udf/Sun, 16 Jan 2022 21:46:37 +0800http://blog.boyangyue.com/2022/01/the-comprehensive-guide-to-hive-udf/<p>One of the most essential features of Spark is interaction with Hive, the data warehouse platform built on top of Hadoop. Naturally, Spark SQL supports the <a href="https://spark.apache.org/docs/latest/sql-ref-functions-udf-hive.html" target="_blank" rel="nofollow noopener noreferrer">integration of Hive UDFs, UDAFs, and UDTFs</a>.</p> <p>At a glance, delving into Hive UDFs might seem unnecessary in the Spark context, considering the extensive functionalities provided by <a href="https://spark.apache.org/docs/latest/sql-ref-functions-udf-scalar.html" target="_blank" rel="nofollow noopener noreferrer">Spark UDF</a>. Nevertheless, Hive UDF could prove indispensable in particular scenarios, such as <strong>building pure SQL environments</strong> or <strong>optimizing performance</strong>. Despite the abundance of Spark tutorials, there is a dearth of practical guides on how to work with Hive UDF, and that&rsquo;s why this article is being written.</p>