Google BigQuery, DataProc Job at Diverse Lynx, Davidson, NC

eGJzTzhkbHc5b0VrSnpxZEVqR0VMb1lkT0E9PQ==
  • Diverse Lynx
  • Davidson, NC

Job Description

Role: Google BigQuery, DataProc
Remote
Full Time

Job Description:
Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines
Responsibilities:
1. Support Data ingestion pipelines, data processing workflows, and data storage solutions using GCP services such as Cloud Storage, Big Query, Dataflow, Composer etc.
2. Work with other DEs to integrate data solutions into applications.
3. Manage & configure data integration processes to extract data from various sources, transform and cleanse it, and load it into appropriate data storage systems.
4. Maintain and support ETL processes to ensure data quality and consistency.
5. Support efficient data retrieval and analysis.
6. Monitor data pipelines and processes for data quality issues.
7. Troubleshoot and resolve data-related problems in a timely manner.
8. Perform regular data backups and implement disaster recovery procedures.
9. Collaborate with cross-functional teams to understand data requirements and provide technical guidance and support.
10. Document data infrastructure, processes, and workflows to ensure knowledge sharing and maintainability.
11. Optimize data structures and queries for performance and scalability as problem management for long running jobs
12. Deployments on BigQuery, BigQuery object provision automation, BigQuery capacity management (Proactive/Reactive)
13. Optimizing and tuning Big Queries, Changes to DDL statements
14. dmin activities e.g., Create/Drop/Alter table/view, Data loads and fixes.
15. Provide configuration details to terraform team.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Job Tags

Full time, Remote job,

Similar Jobs

Houston Methodist Specialty Physician Group

Phlebotomist II - Pathology - Tomball Job at Houston Methodist Specialty Physician Group

 ...The Phlebotomist II performs phlebotomy and other specialized specimen collection procedures for patients both in in-patient and out-patient settings, ranging from routine to advanced functions. Responsibilities include the processing, organizing, labeling and transporting... 

The Pack Labs

Copywriter - Remote - Hemp Brands Job at The Pack Labs

 ...our mission of bringing high-quality cannabinoid products to market. Youll collaborate closely with our marketing and creative teams...  ...copy for a variety of platforms, including web content, social media, email campaigns, and product descriptions. Collaborate with... 

Helpr

Babysitters Job at Helpr

Job Description Job Description Description Helpr is an on-demand childcare app that families use to make bookings for backup care, occasional gigs on an as needed basis across the U.S. As a sitter with Helpr, there is no obligation to take gigs that dont work...

Blind Tiger Brewery & Restaurant

Server Job at Blind Tiger Brewery & Restaurant

You must be at least 18 years of age to serve in our restaurant. Server at Blind Tiger Brewery & Restaurant Are you a highly skilled and motivated individual who loves providing excellent customer service? Do you enjoy working in a dynamic and fun-loving environment... 

Zeteo Tech

Microbiologist Job at Zeteo Tech

 ...security challenges. You will use your expertise to conduct biological laboratory tests to assist scientists in development of tools...  ...decontaminate biological organisms and materials. This is an entry-level position with room for growth. Duties: Perform routine...