…
comment: The repository administrator has not yet configured an RDF license.
primary topic: Automated Table Partitioner (ATAP) in Apache Hive

Automated Table Partitioner (ATAP) in Apache Hive
type: AcademicArticle
type: Article
abstract: Big Data and Predictive Analytics have been a game-changing paradigm in academia and industry for the past decade, inspiring numerous efforts in multiple spaces. One of many such technologies is Hadoop, an open-sourced framework based on MapReduce for highly distributive and scalable solutions. As Hadoop became more popular, other technologies were built, making it an ecosystem by itself. Currently, there are hundreds of tools and utilities that add-on to the Hadoop framework, and Apache Hive is one of the most prominent options. Hive is built as a data warehousing layer that interacts with Hadoop and the underlying filesystem, HDFS. It quickly became the market leader in query processing as it provides better user experience than MapReduce. Nevertheless, it imposes rigid structures that are unyielding to the ever changing nature of data. This paper proposes a novel mean of automating the table partitioning in Hive. It includes a lexical analyzer that reads HiveQL queries and, in return, issues Data Definition Language (DDL) for table restructure if a particular column is read more than the user-set coefficient factor. Multiple experiment made for this research have returned results that further solidified this proof of concept for its feasibility, adaptability and usability. © 2018 IEEE.
date: 2018
status: peerReviewed
status: published
author list: authors
type: EPrint
type: ConferenceItemEPrint
is part of: repository

Institute of Electrical and Electronics Engineers Inc.
type: Organization

2018 4th International Conference on Computer and Information Sciences: Revolutionising Digital Landscape for Sustainable Smart Society, ICCOINS 2018 - Proceedings
type: Collection

T. Amirthalingam
type: Person
given name: T.
family name: Amirthalingam

H.M. Rais
type: Person
given name: H.M.
family name: Rais

HTML Summary of #9858 Automated Table Partitioner (ATAP) in Apache Hive
format: text/html
primary topic: Automated Table Partitioner (ATAP) in Apache Hive