Data engineer - R01542809

Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction.

Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.

Brillio LLC is a fast growing, pure play Digital Transformation Solutions and Services firm backed by Bain Capital private equity. Founded in 2014 and headquartered in Silicon Valley, Brillio is focused on delivering design led solutions for our customers. We are not an IT Services company trying to pivot and support the “next big thing.” As a digitally native company, everything we have done and will continue to do, will have this laser focus.

 

 

A successful candidate will work alongside our existing full-time Data Engineer and will help build a new data pipeline that is a near replica of an existing data pipeline.

 

We have two different backend applications, and currently have a data pipeline that connects one of the backends to a data visualization tool we used called Sisense. The goal will be to build a similar pipeline connecting the second backend to the same data visualization tool, Sisense.

 

So obviously at the very base level we need python and SQL. We use terraform to manage the infrastructure. We use Airflow to orchestrate the pipelines and airflow functions to write different parts of the pipeline. Airflow function I believe is the most important part of the tech stack. We use AWS services like SQS, Lambda, DynamoDB, S3, Redshift. We also run our airflow as a container on AWS using ECS and ECR but aren’t an important part of the tech stack. Familiarity with tools such as dbeaver and periscope would help a lot. Best practices of data warehousing would be a plus to have.

 

In terms of specific technical skills, languages & tools, we are looking for someone comfortable with:

• Hivemind

• Apache Airflow

• AWS DynamoDB

• AWS Redshift

• AWS SQS

As Brillio continues to gain momentum as a trusted partner for our clients in their digital transformation journey, we strive to set new benchmarks for speed and value creation. The Advisory and Value Assurance (AVA) team at Brillio is at the forefront of leading this charge by reimagining and executing how we structure, sell and deliver our services to better serve our clients.

 

Know what it’s like to work and grow at Brillio: https://www.brillio.com/join-us/

Brillio is an equal opportunity employer to all, regardless of age, ancestry, colour, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding, and related medical conditions), and sexual orientation.