All Things Urban

We build open, impactful technology products at the NYC Department of City Planning.

We’re hiring a Data Engineer to grow NYC Planning’s data engineering team. We’re looking for someone highly-motivated and innovative, ready to modernize dataset development by automating processes, and ensuring procedures are reproducible and transparent. You will be involved in the design and implementation of entire data pipelines, from capturing and storing disparate data sources to processing that data and making it available to DCP staff and digital applications. You should understand data, how to improve its quality and accessibility, and be excited about advancing the adoption of new data technologies in New York City government. If you’re interested in shaping the future of city planning and building smarter government, you should definitely apply.

You’ll have the chance to work on EDM’s growing portfolio of initiatives. Some of the products and projects you’ll get to work on include: - Developing and maintaining data pipelines, with a focus on writing scalable, clean, and fault-tolerant code to handle disparate data sources - Automating quality assurance, creating reports and visualizations to debug data processes, check input data, and provide data users with insight into data issues - Working with data owners, city agencies, and the public to improve the quality of existing data products, create new data products, and improve data production and management practices across New York City. - Documenting data idiosyncrasies, bringing order to chaotic upstream data workflows, guaranteeing seamless use in downstream applications. - Sharing your work and lessons learned via blog posts with colleagues and the world - Cross functional projects with NYC Planning Labs

- You have 2 or more years of data engineering experience (or relevant education) building data pipelines with SQL and Python (we use a combination of SQL, bash, Python scripts, and Jupyter notebooks to generate, QA/QC, and manage our data. We’ll be looking to you to help improve these processes.) - You are very organized and thorough, with a proven ability to bring order and logic to heterogeneous data environments. - You have worked on modern data engineering teams and understand the importance of collaboration, teamwork, and writing clear code for your colleagues. - You are comfortable communicating about data with colleagues of varying levels of proficiency. - You are familiar with spatial data formats and have experience working with spatial data in PostGIS and/or Carto.

Must live or being willing to relocate to New York City; must be able to work in the United State. (Sadly, we cannot sponsor visas at the moment)

$60,000 — $74,000, commensurate with experience

Unfortunately, it seems like this job is not available for international candidates. Unless you’re eligible for a work visa otherwise, please double-check with the company.