SQS , EMR , KINESIS

SQS-(Simple Queue Service)

• SQS was the first service available in AWS.
• Amazon SQS is a pay-per-use web service for storing messages in transit between computers.
• Amazon SQS is a web service that gives you access to a message queue that can be used to store messages while waiting for a computer to process them.
• With the help of SQS, you can send, store and receive messages between software components at any volume without losing messages.
• Using Amazon SQS, you can separate the components of an application so that they can run independently, easing message management between components.
• Messages can contain up to 256 KB of text in any format such as JSON, XML, etc.
• Developers use SQS to build distributed applications with decoupled components without having to deal with the overhead of creating and maintaining message queues
• Any component of an application can later retrieve the messages programmatically using the Amazon SQS API.

EMR(Elastic MapReduce)

EMR is a tool used for big data processing and analysis(log analysis, web indexing, data warehousing and in data science (Machine Learning, Business intelligence)).

Amazon EMR offers the expandable low-configuration service.

Amazon EMR is based on Apache Hadoop, a Java-based programming framework that supports the processing of large data sets in a distributed computing environment.

MapReduce is a software framework that allows developers to write programs that process massive amounts of unstructured data in parallel across a distributed cluster of processors or stand-alone computers.

KINESIS

Amazon Kinesis is a managed, scalable, cloud-based service that allows real-time processing of streaming large amount of data per second. It is designed for real-time applications and allows developers to take in any amount of data from several sources, scaling up and down that can be run on EC2 instances.

It is used to capture, store, and process data from large, distributed streams such as event logs and social media feeds. After processing the data, Kinesis distributes it to multiple consumers simultaneously.

Features of Amazon Kinesis

• Real-time processing
• Easy to use
• High throughput, elastic
• Integrate with other Amazon services
• Build kinesis applications
• Cost-efficient

Thank you!!