Display Chinese Characters for Comments in Hive

Problem

Attrition_Flag string ??????

Step by step

Metadata Modification in MySQL for Hive
Metadata Modification with CLI for Hive
Shell Script for Metadata Modification

Automation

Solution in Brief

  1. Write a shell script where proper modification in metadata storage (MySQL) will be progressed.
  2. Place the script into a location where the launch of an EMR cluster can access (I put it on AWS S3).
  3. Make it run in Steps during the launch of the EMR cluster.

Notes

References

  1. Ahmed, 2018. What Is The Correct Syntax For Running A Bash Script As A Step In EMR?. [online] Stack Overflow. Available at: <https://stackoverflow.com/questions/51803980/what-is-the-correct-syntax-for-running-a-bash-script-as-a-step-in-emr> [Accessed 20 November 2020].
  2. Boto3.amazonaws.com. 2020. EMR — Boto3 Docs 1.16.25 Documentation. [online] Available at: <https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/emr.html#EMR.Client.run_job_flow> [Accessed 27 November 2020].
  3. Cwiki.apache.org. 2020. Languagemanual DDL — Apache Hive — Apache Software Foundation. [online] Available at: <https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL> [Accessed 20 November 2020].
  4. Dev.mysql.com. n.d. Mysql :: Mysql 8.0 Reference Manual :: 4.5.1 Mysql — The Mysql Command-Line Client. [online] Available at: <https://dev.mysql.com/doc/refman/8.0/en/mysql.html> [Accessed 20 November 2020].
Photo by Danielle MacInnes on Unsplash

--

--

--

10 x AWS-certified, Data Architect in the 104 Corporation. An AWS Community Builder

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

A non-technical explanation of how computers and programmers speak to each other

Ruby On Rails Tips, Tricks and Shortcuts #1: The Content Tag

Linux — Buffer Overflows

Demystifying and Implementing Spring AOP — Part 2

Openssl for IOT system security development series (Part 1) —  Set up tls client/server from…

Where is my backlog ? — thoughts on innovative product management

Tuesday — Motivation

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Scott Hsieh (史考特)

Scott Hsieh (史考特)

10 x AWS-certified, Data Architect in the 104 Corporation. An AWS Community Builder

More from Medium

Make the DB Optimized

Parsing CVS file from Google Storage using Cloud Function, DataProc and java application using…

Transfer data from Jira to SharePoint using Matillion ETL Tool

AWS Step functions and EMR Clusters — bedrocks for Data Analytics-as-a-Service ecosystem