Subscribe Here!

Why AWS Lambda is a Great Idea

by Kiran Bhageshpur – October 13, 2015

Amazon introduced AWS Lambda last year at ReInvent. I believe Lambda is a game-changer, but it doesn’t go far enough. Let’s begin by reviewing what AWS Lambda is …

 With Lambda you start by writing a microservice. You then specify the conditions under which you want your microservice to run. Examples of events that could “trigger” your microservice include such things as something changing on Amazon S3, a specific condition in an Amazon DynamoDB or a specific condition in an Amazon CloudTrail audit log.

AWS then watches for the event and executes the trigger, at which point it spins up and runs your microservice.

It might be easier to understand with a real-world use case. Netflix uses Lambda to process new media uploaded by studios. The studio uploads content to S3 (for example, the latest episode of Sons of Anarchy). AWS Lambda fires up Netflix’s encoder to encode the media into the required format.

This means that Netflix no longer cares how or when studios upload media files. Studios can upload from any platform entirely independent of Netflix’s systems. This vastly simplifies the process for Netflix.

Why Lambda Matters

There are a slew of advantages to Amazon’s new Lambda approach, but before I describe those, let me describe why this matters right now. When systems are simple, it is easiest to place all logic in a single, monolithic programming stream. A lot of existing corporate apps running in your data center use this model.

However, as systems become increasingly complex one eventually reaches a tipping point where your monolithic code becomes overwhelmingly complex as it tries to account for every situation it may encounter.

Let’s go back to our Netflix example. Without Lambda, Netflix would have had to deploy infrastructure with services that would watch for uploads from various studios. On seeing a new upload they would fire up the appropriate encoder to work on that content. Since there would be a lot of uploads, Netflix will need a scalable server architecture for this layer.

With AWS Lambda, Netflix was able to eliminate an entire layer of infrastructure. The studios upload their media files however they want, and a simple microservice does the encoding once it appears in S3.

That’s the essence of Lambda: It removes complexity. First, there is much less coding (you only code the essence of what you need). Second, you have no infrastructure to buy and manage. Plus, you end-up with zero-touch administration. Amazon takes care of security, availability and issues of scale. All you do is write the microservice and set-it up within Lambda.

One additional benefit is you can tie your microservice to events generated by devices that don’t allow running of programs (for example, a motion detector connected to an ip-addressable thermostat in your warehouse).

The bottom line is that Lambda is brilliant. Much of the industry is justifiably excited about Lambda. But as I said at the top, I don’t think Lambda goes far enough. Just as with AWS Lambda, there are hundreds of use cases that make sense for an on-premises event-based microservice architecture. All that is missing is the platform. More on that in future posts, but what’s your view? Are you using (or planning to use) AWS Lambda? Do you have similar use cases for on-premise apps? Let me know.

Related Content

Top 10 IT Trends for 2019

February 19, 2019

In 2019 and beyond, 451 Research sees a key shift in the world of IT—the breaking apart and coalescing of old silos of technology. Today, technological advances feed off each other to drive innovation. With this new paradigm of technological innovation, 451 Research shares 10 IT trends they predict for 2019.

read more

“Interesting Times” for Unstructured Data Management

January 10, 2019

The expression “may you live in interesting times...” is subject to much debate. To some it is a celebration of the the opportunities to be found in times of transition. To others, it is a cautionary phrase that should be heeded to avoid misfortune. No matter which side of these interpretations you find yourself aligned with, there is no question that 2019 will be a year of significant opportunities and challenges for those responsible for the proper care, management, and stewardship of unstructured data.

read more

8 Principles for a Better Data Management Strategy

December 5, 2018

I’ve spent the better part of three decades leading one of the most demanding high-performance computing infrastructures in the world. One of the greatest challenges of HPC infrastructure is keeping data available and meeting the needs of the business with supporting engineers located in dozens of locations around the world. Here are some key takeaways for anyone struggling with this problem.

read more