Johnny's Odyssey

I used my spare time to explore all kinds of graffiti in NYC. In my opinion, its inclusiveness is the main reason why street culture is prosperous in NYC. I also went to Pride Parade. They’re shining through the parade, and I can feel their confidence and passion coming out of their body. This is also a sign of inclusiveness in NYC.

There are a bunch of photos I took below, and you click this link to check out these locations. Just treat this as a treasure hunt game! Have fun!

This document is aimed to help you familiar with Amplify quickly. In addition, I’ll take you to go through the code structure and deployment architecture of my POC.

What is Amplify

Amplify is an all-in-one platform for frontend developers to develop, test, and deploy the whole website or mobile app. The frontend developers only need to know vanilla JavaScript or React or Vue.js, the knowledge of RestAPI, and database management is not necessary for this platform cause Amplify Studio can help frontend developers to maintain these through the UI.

I have really enjoyed working with IT team at MIO last two months. Through this internship, I have been able to learn not only what the US working style is like, but also some real AWS projects. Now, I’m sure to continue brushing up on my AWS skills to find a full-time role.

Thank you all guys helped me and supported me! I hope you all the best!

Traditionally, using Gitlab + Jenkins + K8s + Docker may better for some e-commerce systems development. But you need to put more time to configure and maintain this setup. This is not easy and some unfortunate issues may comes frequently.

IAM

1. IAM role policy only define which API actions can be made to that role.

What is Apache Hive?

As the data grew in size, there was also the scarcity of Java developers who can write complex MapReduce jobs for Hadoop. Hence the advent of Hive comes which is created on top of Hadoop itself. Hive provides a SQL like a language termed HiveQL interface for users to extract data from a Hadoop system. With the simplicity provided by Hive to transform simple SQL queries into Hadoop’s MapReduce jobs, and runs them against a Hadoop cluster.

Brief of NiFi

Apache NiFi is a software project from the Apache Software Foundation designed to automate the flow of data between software systems.

Software development and the commercial support is currently offered by Hortonworks (now merged into Cloudera), who acquired NiFi’s originator, Onyara Inc.

Apache NiFi supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic. Some of the high-level capabilities and objectives of Apache NiFi include:

Prerequisite

1. Establishing a complete Hadoop ecosystem such as using Ambari.

   For how to establish a complete Hadoop ecosystem by Ambari, you can check the posts - “Step by Step Tutorial for Ambari Installation” or “Tutorial for Latest Ambari(2.7.1)”.

2. Installing Hive for enterprise data warehouse (EDW).

3. Offering visual Hive query tools such as Hue.

4. Installing NiFi for processing data flow itinerantly.

Installed Ambari and HDP are prerequisites for installing HDF on HDP clusters. So, after that, you can follow the steps below to complete installing HDF.