Join our Team.
NorthBay is looking for talented and motivated individuals that are looking to join our rapidly growing company and help us get to the next level. No agencies please.
We are currently hiring qualified professionals for the following positions:
NorthBay Solutions is recognized as a premier provider of Big Data Solutions & Services. We are an AWS advanced consulting partner certified in big data, public sector, mobile, machine learning, DevOps and education competencies. We design big data, mobile & web solutions for premier brands and working with some of the most progressive companies in the world and creating profoundly impactful solutions.
NorthBay is seeking technically savvy hands-on Big Data Solutions Architects to implement solutions for our customers working with our offshore engineering team. In this role, you will collaborate with NorthBay customers, some working onsite, understand requirements and needs, translate into specifications to develop solutions, drive work with offshore engineering teams, and deliver solutions and results to the customer. This includes assessing customer needs, re-engineering business intelligence processes, designing and developing data models, and sharing your expertise throughout the deployment process.
Responsibilities:
- Interface with client project sponsors to gather, assess and interpret client needs and requirements
- Develop a data model and Data Lake design around stated use cases to capture client’s KPIs and data transformations
- Identify one or more relevant AWS services — especially on Amazon EMR — and an architecture that can support client workloads/use-cases; evaluate pros/cons among the identified options before arriving at a recommended solution optimal for the client’s needs.
- Be able to explain to the client the tradeoffs among the various AWS options, and why the recommended solution(s) and architecture was chosen as an optimal one for the the client’s needs.
- Work closely with the client and broader NorthBay Delivery team to implement in Agile fashion the architecture and chosen AWS services using AWS Best Practices and principles from the AWS Well-Architected Framework
- Assess, document and translate goals, objectives, problem statements, etc. to our offshore team and onshore management
- Advising on database performance, altering the ETL process, providing SQL transformations, discussing API integration, and deriving business and technical KPIsHelp transition the implemented solution into the hands of the client, including providing documentation the client can use to operate and maintain the solution.
- Help NorthBay Solutions with its Continuous Improvement processes to learn from each customer project, including doing project retrospectives and writing up “Lessons Learned”.
- Able to travel up to 50% (US- Domestic)
Qualifications (Must Haves)
- Strong Design / Development Experience on Amazon EMR, preferably with Spark (PySpark, Scala)Strong troubleshooting / admin experience with EMR – specific infrastructure (CloudFormation) code, deployment via AWS CLI, and bootstrap actions.
- Ability to implement transient infrastructure (e.g. transient EMR clusters) that leverages decoupled storage (S3) and compute. Implement these using reproducible automated mechanisms like AWS CLI scripts, CloudFormation templates, and custom code leveraging AWS SDKs.
- Strong experience on one or more MPP Data Warehouse Platforms preferably Amazon EMR (incl. Presto), Amazon Athena, AWS RedShift, PostgreSQL, Teradata or similar Possess in-depth working knowledge and hands-on development experience in building Distributed Big Data Solutions including ingestion, caching, processing, consumption, logging & monitoring
- Strong Development Experience on at least one or more event-driven streaming platforms preferably Kinesis, Firehose, Kafka, Spark Streaming, or Apache Flink
- Strong Data Orchestration experience using one or more of these tools: AWS Step Functions, Lambda, AWS Data Pipeline, AWS Glue orchestration, Apache Airflow, Luigi or related
- Strong understanding and experience with Cloud Storage infrastructure, and operationalizing AWS-based storage services & solutions preferably S3 or related
- Strong technical communication skills and ability to engage a variety of business and technical audiences explaining features, metrics of Big Data technologies based on experience with previous solutions
- Strong Understanding of at least one or more Cluster Managers (YARN, Hive, Kubernates, Pig, etc)
Qualifications (Nice to Haves)
- Strong Data Cataloging experience preferably using AWS Glue or Other
- Strong Development Experience on at least one NoSQL OR Document databases
- Experience on at least one or More Ingestion Integration tools Like Apache NIFI or Streamset or related
- Strong Development Experience on at least one Caching Tool like Amazon Elasticache (with Redis or Memcached) or Lucene
- Strong Understanding and experience in Big Data Audit Logging and Monitoring solutions like AWS CloudTrail and CloudWatch.
Additional Qualifications:
- 5+ years of AWS Solutions implementation, professional services experience, prefer Data Analytics space.
- A passion for exploring data and extracting valuable insights.
- Proven analytical, problem solving, and troubleshooting expertise.
- Proficiency in SQL, preferably across a number of dialects (we commonly write MySQL, PostgreSQL, Redshift, SQL Server, and Oracle).
- Exposure to developer tools/workflow (e.g., git/github, *nix, SSH)Experience optimizing database/query performance.
- Experience with AWS ecosystem (EC2, S3, RDS, Redshift).Experience with business intelligence tools with a physical model (e.g., MicroStrategy, Business Objects, Cognos).Experience with data warehousing.
- Exposure to NoSQL-based, SQL-like technologies (e.g., Hive, Pig, Spark SQL/Shark, Impala, BigQuery)
- Excellent verbal and written communication skills
Education and Experience:
- Bachelor’s Degree in Computer Science or Equivalent
- Minimum five years of Big Data Engineering on AWS experience
Desired Certifications:
- AWS Solution Architect
- AWS Big data Specialty
- Or any Data Centric Certifications
The position is based in NYC. It is a requirement to be on-site 5 days a week.
Responsibilities
- Lead the Data Cloud development effort focusing on scalability, quality and performance
- Manage a team of data engineers located both on and off shore
- Serve as the organization’s expert on DC platform technologies and architecture
- Perform employee performance reviews and regular one-on-one sessions
- Perform code reviews
- Ensure adherence to enterprise best practices
- Design efficient, scalable processes to acquire, manipulate and project data
- Participate actively in all facets of the Agile process
- Contribute to the DC codebase directly by taking on development tasks
Qualifications
- Bachelor’s Degree in Computer Science, Math, Statistics or other quantitative discipline
- 8+ years experience implementing enterprise data solutions
- 3+ years experience in a management role
- Extensive experience with AWS data services: Redshift, RDS, DynamoDB, Data Pipeline, EMR
- Extensive experience writing and tuning SQL queries
- 5+ years using ETL / data movement tools (talend, Pentaho, Glue, SSIS, Sqoop, Matillion, Informatica)
- 3+ years programming in one or more languages (Python, Java, Scala, C/C++)
- 2+ years experience with NoSQL data platforms
- Experience implementing a data lake architecture
- Experience with Agile process methodology, CI/CD automation, Test Driven Development
- Experience with AWS Kinesis, Kafka, Storm, Spark, SonarQube highly desired
· Migrate and re-engineer existing services from physical data centers to AWS cloud
· Write scripts to automate operations and server management
· Maintain QA and Production configuration using automation tools
· Build and maintain operations tools for monitoring, notifications, trending, and analysis.
· Define, create, test, and execute operations procedures.
· Troubleshoot production issues
· Install OS updates/hotfixes/patches/service packs
· Work with Application Developers to automate builds and software deployments to QA & production
· Maintain and enhance the Continuous Integration & Deployment environment
· Document current and future configuration processes and policies
· Must have demonstrable experience with either or both of the following technologies
· Terraform
· AWS Cloudformation
· Optional but desirable
· Powershell
· Shell scripting
· Python at intermediate level
· AWS or major cloud certifications , AWS associate or higher.”
NorthBay Solutions is recognized as a premier provider of Big Data Solutions & Services. We are an AWS advanced consulting partner certified in big data, public sector, mobile, machine learning, DevOps and education competencies. We design big data, mobile & web solutions for premier brands and working with some of the most progressive companies in the world and creating profoundly impactful solutions.
NorthBay is seeking technically savvy Senior Big Data Engineer to implement solutions for our customers working with our offshore engineering team. In this role, you will collaborate with NorthBay customers, some working onsite, understand requirements and needs, translate into specifications to develop solutions, drive work with offshore engineering teams, and deliver solutions and results to the customer. This includes assessing customer needs, re-engineering business intelligence processes, designing and developing data models, and sharing your expertise throughout the deployment process.
Responsibilities Include but Not Limited to:
- Possess In depth knowledge and hands on development experience in building Distributed Big Data Solutions including ingestion, caching, processing, consumption, logging & monitoring) (Must Have)
- Strong Development Experience in either one of the Distributed Big Data processing (bulk) engines preferably using Spark on EMR or related (Must Have)
- Strong Development Experience on at least one or more event driven streaming platforms prefer Kinesis, Firehose, Kafka or related (Must Have)
- Strong Data Orchestration experience using tools such has AWS Step Functions, Lambda, AWS Data Pipeline, Apache Airflow or related (Must Have)
- Assess use cases for various teams within the client company and evaluate pros and cons and justify recommended tooling and component solution options using AWS native services, 3rd party and open source solutions (Must Have)
- Strong experience on either one or more MPP Data Warehouse Platforms prefer AWS RedShift, PostgreSQL, Teradata or similar (Must Have)
- Strong understanding and experience with Cloud Storage infrastructure and operationalizing AWS based storage services & solutions prefer S3 or related (Must Have)
- Strong technical communication skills and ability to engage a variety of business and technical audiences explaining features, metrics of Big Data technologies based on experience with previous solutions (Must Have)
- Strong Data Cataloging experience preferably using AWS Glue (Nice to Have)
- Strong Development Experience on at least one NoSQL OR Document databases (Nice to Have)
- Experience on at least one or More Ingestion Integration tools Like Apache NIFI or Streamset or related (Nice to Have)
- Strong Development Experience on at least one Caching Tools like Redis, Lucene, Memcached (Nice to Have)
- Strong Understanding and experience in Big Data Audit Logging and Monitoring solutions (Nice to Have)
- Strong Understanding of at least one or more Cluster Managers (Yarn, Hive, Pig, etc) (Nice to Have)Interface with client project sponsors to gather, assess and interpret client needs and requirements
- Advising on database performance, altering the ETL process, providing SQL transformations, discussing API integration, and deriving business and technical KPIs
- Develop a data model around stated use cases to capture client’s KPIs and data transformations
- Assess, document and translate goals, objectives, problem statements, etc. to our offshore team and onshore management
- Document and communicate product feedback in order to improve user experience
Qualifications:
- 5+ years of AWS Solutions implementation, professional services experience, prefer Data Analytics space.
- A passion for exploring data and extracting valuable insights.
- Proven analytical, problem solving, and troubleshooting expertise.
- Proficiency in SQL, preferably across a number of dialects (we commonly write MySQL, PostgreSQL, Redshift, SQL Server, and Oracle).
- Exposure to developer tools/workflow (e.g., git/github, *nix, SSH)Experience optimizing database/query performance.
- Experience with AWS ecosystem (EC2, S3, RDS, Redshift).Experience with business intelligence tools with a physical model (e.g., MicroStrategy, Business Objects, Cognos).Experience with data warehousing.
- Exposure to NoSQL-based, SQL-like technologies (e.g., Hive, Pig, Spark SQL/Shark, Impala, BigQuery)
- Excellent verbal and written communication skillsAbility to travel up to 50% (Boston Metro area)
Education and Experience:
- Bachelor’s Degree in Computer Science or Equivalent
- Minimum five years of Big Data Engineering on AWS experience
NorthBay Solutions is recognized as a premier provider of Big Data Solutions & Services. We are an AWS advanced consulting partner certified in big data, public sector, mobile, machine learning, DevOps and education competencies. We design big data, mobile & web solutions for premier brands and working with some of the most progressive companies in the world and creating profoundly impactful solutions.
NorthBay is seeking technically savvy Senior Big Data Engineer to implement solutions for our customers working with our offshore engineering team. In this role, you will collaborate with NorthBay customers, some working onsite, understand requirements and needs, translate into specifications to develop solutions, drive work with offshore engineering teams, and deliver solutions and results to the customer. This includes assessing customer needs, re-engineering business intelligence processes, designing and developing data models, and sharing your expertise throughout the deployment process.
Responsibilities Include but Not Limited to:
- Possess In depth knowledge and hands on development experience in building Distributed Big Data Solutions including ingestion, caching, processing, consumption, logging & monitoring) (Must Have)
- Strong Development Experience in either one of the Distributed Big Data processing (bulk) engines preferably using Spark on EMR or related (Must Have)
- Strong Development Experience on at least one or more event driven streaming platforms prefer Kinesis, Firehose, Kafka or related (Must Have)
- Strong Data Orchestration experience using tools such has AWS Step Functions, Lambda, AWS Data Pipeline, Apache Airflow or related (Must Have)
- Assess use cases for various teams within the client company and evaluate pros and cons and justify recommended tooling and component solution options using AWS native services, 3rd party and open source solutions (Must Have)
- Strong experience on either one or more MPP Data Warehouse Platforms prefer AWS RedShift, PostgreSQL, Teradata or similar (Must Have)
- Strong understanding and experience with Cloud Storage infrastructure and operationalizing AWS based storage services & solutions prefer S3 or related (Must Have)
- Strong technical communication skills and ability to engage a variety of business and technical audiences explaining features, metrics of Big Data technologies based on experience with previous solutions (Must Have)
- Strong Data Cataloging experience preferably using AWS Glue (Nice to Have)
- Strong Development Experience on at least one NoSQL OR Document databases (Nice to Have)
- Experience on at least one or More Ingestion Integration tools Like Apache NIFI or Streamset or related (Nice to Have)
- Strong Development Experience on at least one Caching Tools like Redis, Lucene, Memcached (Nice to Have)
- Strong Understanding and experience in Big Data Audit Logging and Monitoring solutions (Nice to Have)
- Strong Understanding of at least one or more Cluster Managers (Yarn, Hive, Pig, etc) (Nice to Have)Interface with client project sponsors to gather, assess and interpret client needs and requirements
- Advising on database performance, altering the ETL process, providing SQL transformations, discussing API integration, and deriving business and technical KPIs
- Develop a data model around stated use cases to capture client’s KPIs and data transformations
- Assess, document and translate goals, objectives, problem statements, etc. to our offshore team and onshore management
- Document and communicate product feedback in order to improve user experience
Qualifications:
- 5+ years of AWS Solutions implementation, professional services experience, prefer Data Analytics space.
- A passion for exploring data and extracting valuable insights.
- Proven analytical, problem solving, and troubleshooting expertise.
- Proficiency in SQL, preferably across a number of dialects (we commonly write MySQL, PostgreSQL, Redshift, SQL Server, and Oracle).
- Exposure to developer tools/workflow (e.g., git/github, *nix, SSH)Experience optimizing database/query performance.
- Experience with AWS ecosystem (EC2, S3, RDS, Redshift).Experience with business intelligence tools with a physical model (e.g., MicroStrategy, Business Objects, Cognos).Experience with data warehousing.
- Exposure to NoSQL-based, SQL-like technologies (e.g., Hive, Pig, Spark SQL/Shark, Impala, BigQuery)
- Excellent verbal and written communication skillsAbility to travel up to 50% (Boston Metro area)
Education and Experience:
- Bachelor’s Degree in Computer Science or Equivalent
- Minimum five years of Big Data Engineering on AWS experience
We are seeking a Senior DevOps Engineer and Developer to join our team supporting a leading provider of application security solutions. Play an instrumental role in the evolution of tooling and team into an advanced DevOps operational model. Using and leveraging a technical stack including combination of GitLabs pattern, Terraform and Custom Services development in Python for infrastructure as code, pipelines development and orchestration. This resource will be responsible for helping to further design and implement our CI/CD environment and processes for supporting line of business products and applications and managing their lifecycle through automation, consistent, reliable and repeatable workflows. Helping developers to build and innovate and deploy product code faster, securely and create solutions developers need to exploit benefits of DevOps and CI/CD.
Primary Responsibilities:
- Develop and support processes to maintain uptime, SLAs and availability of critical platform components.
- Monitor existing application and infrastructure while working to improve existing monitoring.
- Communicate effectively with project stakeholders and management.
- Share the responsibility of supporting the environment and product during off-hours.
Required Skills/Experience:
- Bachelor’s Degree in Computer Science, Information Science, Engineering or related/relevant field.
- Master’s degree preferred. Successful experience building out and supporting a Cloud production environment
- Required AWS SDK Python Boto3 working with custom, cots, and open source Python libraries.
- Familiarity with native AWS DevOps PaaS toolset, AWS CodeBuild, AWS CodePipeline
- Knowledge of cloud deployment tools and methodologies including Terraform (Packer, Troposphere, AWS CloudFormation required)
- .Experience with more than one configuration management solution (i.e. Chef, Puppet, Ansible, AWS CodeDeploy).
- Solid proficiency with Repository AND Pipeline related tools (GitLab, GIT – Jenkins, Bamboo, Travis, Circle CI).
- Experience with the implementation and use of different Application and Infrastructure monitoring tools.
- Proficiency in one or more programming languages. Python is required. Communicate effectively, written and verbal to a range of audiences.
- Must be a leader individual contributor, assume ownership for tasks and have great attention to detail.
- Comprehensive debugging and troubleshooting skills.
- Ability to thrive in a fast-paced environment.
Desired Experience:
- Experience designing infrastructure as code using Python and working in a secure development lifecycle.
- Experience sharing the innovative work you do at conferences, meetups, etc.
- Experience with core systems like LDAP and NTP.
- Experience with AWS Config.
Education:
- Bachelor’s Degree in Computer Science or Equivalent
Why work with us?
We are working with some of the most progressive companies in the world and creating profoundly impactful web and mobile solutions for them. We need rock stars that love creativity, have a passion for excellence, and strive to be the best.
Other Skills?
We are always looking for talented and passionate people.