Index ¦ Archives ¦ Atom ¦ RSS

Is moving to the Bay Area worth it?

I came across this article on the front page of Hacker News yesterday. The author argues that Bay Area housing prices may be high, but the salary increase probably makes it worth while. The author pulls together some interesting data to make their point, but I have major issues with …


Announcing the Cross Sectional Dataset

I'm happy to announce a new telemetry dataset!

The Cross Sectional dataset makes it easy to describe our users by providing summary statistics for each client. Like the Longitudinal table, there's one row for each client_id in a 1% sample of clients. However, the Cross Sectional dataset simplifies your analysis …


Meta Documentation

You'll see a lot of posts coming down the line on documentation.

We surveyed our customers last quarter and asked where our data pipeline was lacking. It turns out the most painful part of using our data pipeline, is reading the documentation. I've been interesting in learning how to write …


Why Markdown?

[TOC]

Last week I finished a pull request that moved some documentation from mozilla's wiki to a github repository. It took a couple of hours of editing and toying with pandoc to get right, but when I was done, I realized the benefits were difficult to see. So, I decided …


Working over SSH

[TOC]

Introduction

Working over SSH can be impossibly frustrating if you're not using the right tools. I promised my teammates a write-up how I work over ssh. Using these tools will make it significantly easier / more fun to work with a remote linux system.

Tools

tmux

For me, tmux is …


Strange Spark Error

[TOC]

Introduction

I spend the better part of last week debugging a Spark error, so I figure it's worth writing up.

The Bug

I added the this very simple view to our batch views repository.

package com.mozilla.telemetry.views

import org.apache.spark.{SparkConf, SparkContext}
import org.apache.spark …

© Ryan T. Harter. Built using Pelican. Theme by Giulio Fidente on github.