Data Pipeline Developer

Data Pipeline Developer

Job Description

Are you interested in applying your Data Pipeline skills to support Indigenous self-determination?


As a Data Pipeline Developer, you’ll be joining a development team working on SIKU: the Indigenous Knowledge Social Network. SIKU provides satellite imagery, maps, and weather services to Indigenous communities across the Canadian and International North.

You’ll be responsible for designing, refactoring and implementing our data pipelines, working on a team with cartography and remote sensing specialists as well as mobile and web developers to ingest and transform massive geospatial data sources, such as RADARSAT Constellation Mission data, into scalable and efficient products that can be delivered via the SIKU platform.

You’ll have the opportunity to work with a growing team delivering cutting-edge technologies in support of Indigenous-self determination in environmental stewardship, monitoring, and research. As winners of the 2017 Google.org Impact challenge, we are a small non-profit with a big track record of building strong technology partnerships and delivering innovative Indigenous solutions for thriving communities.

What will you do?

  • Make data accessible to remote northern communities! Design, develop, and operationalize data pipelines and infrastructure for delivery of a variety of large data sources (primarily consisting of large volumes of geospatial data and satellite imagery).
  • Architect solutions that are scalable, maintainable and efficient through pipeline automation. We use various approaches for near real-time, batch, caching and event-driven solutions.
  • Troubleshoot and inspect existing solutions to identify potential issues, propose solutions and develop monitoring alerts to ensure the ongoing smooth operation of product delivery.
  • Be a team player. Write clear documentation, use source control, and collaborate effectively with project managers, web developers, cartographers and remote-sensing specialists.
  • Work with a variety of web-based tools and services including Cloud Data Solutions such as GCP, APIs, Google Earth Engine, Linux/Docker, Jira, and BitBucket.

You’ll bring

  • Excellent interpersonal and communication skills
  • Problem-solving skills
  • Strong technical skills and experience
  • Ability to embrace change and adapt to shifting priorities
  • Design-centred thinking
  • A passion for working with the latest technologies

Requirements

  • 5+ years of web-based software development experience
  • Experienced in architecting solutions to automate ingestion, batch processing, storing, caching and delivery of large volumes of data.
  • Strong understanding of the challenges that come with building production-grade, fast, scalable, and reliable cloud-based systems and pipelines.
  • Solid programming skills in Python, JavaScript, bash scripting and the ability to learn new languages as needed to solve problems.
  • Familiarity working with multithreading and concurrency.
  • Experience working with cloud storage and computing. (We currently use GCP)
  • Proficient with git and version control.
  • Experienced with creating clear and concise documentation.
  • Fluent in both written and oral English and able to work in North American time zones.

Good to have

  • Experience working with geospatial and remote sensing data, libraries and services such as GDAL and Google Earth Engine.
  • Experience working in Docker-based development environments
  • Familiarity with the Atlassian Suite (Bitbucket, Jira, Confluence).
  • Experience working in Agile development framework
  • AI/machine learning infrastructure experience
  • Strong preference for applicants in Canada but would consider very strong candidates working in North American time zones.
  • Experience with server-side -data processing
  • Experience with Rust, C++, or C would be an asset.
  • Familiarity with Ci/CD patterns. With preference given to those with experience with bitbucket pipelines.

Contract Details

  • Type: Full-time 6-month contract with the understanding that if there is a good fit the contract could be renewed.
  • Location: Remote/Work-from-home. The Arctic Eider Society is based in Sanikiluaq, Nunavut and has over 10 years of experience working as a remote team from coast to coast to coast.
  • Salary: $45 – $60 / hour, commensurate with experience
  • Inclusion and Diversity: The Arctic Eider Society is a safe space to work and we encourage Indigenous, Black, People Of Colour and people of all genders, sexual identities and disabilities to apply for this position.

About SIKU

SIKU, the Indigenous Knowledge Social Network, is an iOS , Android and web app by and for Indigenous communities that facilitate Indigenous self-determination at scale by providing cutting-edge tools and services for ice safety, language preservation and weather.

About the Arctic Eider Society

The Arctic Eider Society is an Indigenous technology charity based in Sanikiluaq, Nunavut, Canada which facilitates Indigenous-driven solutions for thriving communities. We provide meaningful work, a small team, competitive compensation and flexible work arrangements to facilitate indigenous self-determination at scale.

Apply