Enable America Jobs

Enable America Logo

Job Information

Capgemini AWS Databricks Engineer (Unity Catalog) in Ohio, United States

AWS Databricks Engineer (Unity Catalog)

Job Title: AWS Databricks Engineer (Unity Catalog)

Job location: Cleveland, OH.

Key Responsibilities:

AWS:

  • Strong proficiency in Python

  • Experienced in Building S3 file systems via code pipelines.

  • Experienced in Creating and using IAM roles.

  • Experienced in building and managing Key Management Services.

  • Experienced in creating and using AWS transfer Family and Storage Gateway mechanism.

  • Experienced in building and using CloudFormation templates.

  • Experienced in standing up and maintaining EC2 instances and Lambda services.

  • Experienced in standing up Kubernetes clusters and maintenance.

  • Previous experience with data visualization tools Power BI Tableau.

  • Strong experience with GIT and CI CD Pipelines.

Databricks

  • Extensive experience in Databricks technology.

  • Extensive experience in data mapping data architecture and data modeling on Databricks.

  • Extensive experience in Design implementation and maintenance of data pipelines using Python pyspark on Databricks.

  • Strong proficiency in Python and PySpark able to write and execute complex queries to perform curation and build views required by end users single and multi dimensional.

  • Extensive experience in Databricks Data engineering Job Runs Data Ingestion and Delta Live Tables.

  • Strong experience in setting up and maintaining SQL Warehouses SQL Editor and alerts.

  • Strong experience in setting up and maintaining workspaces catalogs workflows and Compute.

  • Experienced with All purpose compute Job computes SQL Warehouse Vector search Pools and Policies.

  • Experienced in setting up and maintaining the Unity catalog.

  • Experienced in creating and maintaining Databricks schema objects Notebooks scheduler and Job clusters.

  • Strong experience in building Notebooks with complex code structures.

  • Strong experience in building and maintaining the Autoloader process.

  • Strong experience in the usage of Table ACL Row and Column Level Security With Unity Catalog.

  • Strong experience in Data Ingestion Storage Harmonization and curation.

  • Proven experience in performance and tuning to ensure jobs are running at optimal levels and no performance bottleneck.

  • Experienced in data ingestion using various methods API Direct database reads AWS Cross account data copy third party vendor data using FTP process etc.

  • Proven experience in debugging failed jobs.

Life at Capgemini:

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

  • Flexible work

  • Healthcare including dental, vision, mental health, and well-being programs.

  • Financial well-being programs such as 401(k) and Employee Share Ownership Plan

  • Paid time off and paid holidays

  • Paid parental leave.

  • Family building benefits like adoption assistance, surrogacy, and cryopreservation

  • Social well-being benefits like subsidized back-up child/elder care and tutoring

  • Mentoring, coaching, and learning programs.

  • Employee Resource Groups.

  • Disaster Relief.

About Capgemini:

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, its clients to unlock the value of technology to address the entire breadth of their business needs trust Capgemini. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, and combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.

Get the future you want |

Disclaimer:

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Click the following link for more information on your rights as an Applicant

Ref: 1833795

Posted on: Jul 9, 2024

Experience level: Experienced (non-manager)

Contract Type: Permanent Full Time

Location:

Ohio, US

Department: Financial Services

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

DirectEmployers