Software Engineering Daily

Prefect Dataflow Scheduler with Jeremiah Lowin

A data workflow scheduler is a tool used for connecting multiple systems together in order to build pipelines for processing data. A data pipeline might include a Hadoop task for ETL, a Spark task for...

Apr 29, 2020

CockroachDB with Peter Mattis

A relational database often holds critical operational data for a company, including user names and financial information. Since this data is so important, a relational database must be architected to...

Apr 28, 2020

Dask: Scalable Python with Matthew Rocklin

Python is the most widely used language for data science, and there are several libraries that are commonly used by Python data scientists including Numpy, Pandas, and scikit-learn. These libraries im...

Apr 27, 2020

Rasa: Conversational AI with Tom Bocklisch

Chatbots became widely popular around 2016 with the growth of chat platforms like Slack and voice interfaces such as Amazon Alexa. As chatbots came into use, so did the infrastructure that enabled cha...

Apr 24, 2020

Cloudburst: Stateful Functions-as-a-Service with Vikram Sreekanti

Serverless computing is a way of designing applications that do not directly address or deploy application code to servers. Serverless applications are composed of stateless functions-as-a-service and...

Apr 23, 2020

NGINX API Management with Kevin Jones

NGINX is a web server that can be used to manage the APIs across an organization. Managing these APIs involves deciding on the routing and load balancing across the servers which host them. If the tra...

Apr 22, 2020

Frontend Monitoring with Matt Arbesfeld

Web development has historically had more work being done on the server than on the client. The observability tooling has reflected this emphasis on the backend. Monitoring tools for log management an...

Apr 21, 2020

Zoom Vulnerabilities with Patrick Wardle

Zoom video chat has become an indispensable part of our lives. In a crowded market of video conferencing apps, Zoom managed to build a product that performs better than the competition, scaling with h...

Apr 20, 2020

Facebook OpenStreetMap Engineering with Saurav Mohapatra and Jacob Wasserman

Facebook applications use maps for showing users where to go. These maps can display businesses, roads, and event locations. Understanding the geographical world is also important for performing searc...

Apr 17, 2020

NGINX Service Mesh with Alan Murphy

NGINX is a web server that is used as a load balancer, an API gateway, a reverse proxy, and other purposes. Core application servers such as Ruby on Rails are often supported by NGINX, which handles r...

Apr 16, 2020

Shopify React Native with Farhan Thawar

Shopify is a platform for selling products and building a business. It is a large e-commerce company with hundreds of engineers and several different mobile apps. Shopify’s engineering culture is will...

Apr 15, 2020

Ceph Storage System with Sage Weil

Ceph is a storage system that can be used for provisioning object storage, block storage, and file storage. These storage primitives can be used as the underlying medium for databases, queueing system...

Apr 14, 2020

Collaborative SQL with Rahil Sondhi

Data analysts need to collaborate with each other in the same way that software engineers do. They also need a high quality development environment. These data analysts are not working with programmi...

Apr 13, 2020

Reserved Instances with Aran Khanna

When a developer spins up a virtual machine on AWS, that virtual machine could be purchased using one of several types of cost structures. These cost structures include on-demand instances, spot insta...

Apr 10, 2020

Snorkel: Training Dataset Management with Braden Hancock

Machine learning models require the use of training data, and that data needs to be labeled. Today, we have high quality data infrastructure tools such as TensorFlow, but we don’t have large high qual...

Apr 09, 2020