For the third part of this series of articles, we will create a small Redshift instance, and we will learn how to synchronize data between S3 and Redshift.
The first step will be to use AWS Identity and Access Management IaM to create a role for Redshift to access S3.
On the second step we will create a sample Redshift cluster, and finally, we will use a special SQL COPY command to ingest the JSON data from S3 into Redshift.
Following my previous post, In this post I will try to provide a step by step guide to build a sample solution of an infrastructure for IoT in China.
Apart from Docker and DevOps methodologies, the other big topics that I enjoy the most currently at work are Cloud Architecture and Big Data/IoT.
In this article I would like to describe a little bit the situation of AWS in China, specially what is the current status of Services Available and what is the forecast of improvement that we can hopefully expect for the next months.
I will also try to provide a step by step guide to create an infrastructure made with IoT in mind, where we can achieve an scalable, secure and ServerLess installation using only AWS Services that are currently available in China.
Stateless is used as a solution for everything nowadays: scale, containerize, make fault tolerant… But it is a reality that not everything can be stateless, even if you store the configurations inside the containers, you need to store static files somewhere, you need databases that are stateful by definition, and not all the tools that you will be using are created to be stateless.
