All Posts

Using Apache Airflow and the Snowflake Data Warehouse to ingest Flume S3 data

Do you use Apache Flume to stage event-based log files in Amazon S3 before ingesting them in your database? Have you noticed .tmp files scattered throughout S3? Have you wondered what they are and how to deal with them? This article describes a simple solution to this common problem, using the Apache Airflow workflow manager and the Snowflake Data Warehouse.

Senior Staff Engineer

So You Want To Build a Keyboard

My journey begins with me already owning two keyboards, one for work and one for home. I was by all means already pushing the boundaries of minimalism. But then I saw The WhiteFox and I knew I simply had to have it in my life. And the only way I could justify getting a third keyboard (and get the...

Senior Software Engineer

Engineers moving into leadership sometimes have a hard time navigating the increased demands for meetings. And when meetings waste your time, or go off the rails, it hurts your team’s productivity and even affect their ability to work together. How can you make meetings better? In her talk, “Three Ways to Grow Your Happiness in Meetings,” Marcy Swenson offers great strategies for making meetings vital and worthwhile.

Director of Engineering, Exchange

Embracing Inconsistency

Humans are inconsistent and unpredictable by nature. This can come in the form of conflicting requests from upper management or from engineers who want to change teams only to want to quickly change again. Our job as leaders is to accept that fact and deal with the consequences.

What Do 1-on-1s Really Mean?

“If someone tells you that you are an irritating boss, that is a huge gift they are giving you…”

As a leader, you have the responsibility to develop individuals on your team. One of the ways to move an employee forward is to gain insight on their thoughts about their place on the team. But how do you gain this insight?

We have seen progress, but still have a long way to go before we reach gender parity in leadership. There is a constant stream of new content reminding us that this is a problem, but rarely do we see comprehensive research and actionable advice.

Say It Right

Giving feedback is easy. Giving constructive, actionable feedback is not. In this talk, Tasneem Minadakis, Head of Rider Growth at Uber, draws upon her 12+ years in the industry to teach you how to do just that, laying out a framework you can use to provide more valuable feedback.

Senior Software Engineer

What Should I Be Doing Right Now?

As a manager, how do you decide what to spend your time on each day?

Cynthia Maxwell, Director of iOS Engineering at Slack provides a framework for how managers should focus their time. As a mom, maintaining a healthy work-life balance is important to her, and the framework she’s developed aims to do just that.

Accelerating Impact

“It’s a lot easier to loosen up some of the structure over time than it is to later go back and inject it.”

Engineering onboarding has become more important as many companies rapidly scale their engineering teams. Companies are starting to realize how much they are missing out by not having their new engineers be productive as soon as possible, instead of relying on ad-hoc methods to bring people up to speed.