Big Data Engineer Job at micro1, San Francisco, CA

TzhBODlaV0VxZlJTV3NjTXRwRG1ZYTB5OXc9PQ==
  • micro1
  • San Francisco, CA

Job Description

pay

Required Skills
big data
Python
databases
data engineering
About micro1
micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real-world expertise into high-quality training data, evaluations, and feedback loops that improve how AI systems learn, reason, and perform.

Our platform identifies and vets top talent through an AI recruiter, enabling high-quality expert contributions at scale. We aim to enable 1 billion people to do meaningful work by applying their expertise to AI. As our global expert network grows, micro1 is building the human intelligence layer for frontier AI.

Job Title: Big Data Engineer

Job Type: Contractor

Location: Remote

Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input.

Key Responsibilities

Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.
Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.
Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.
Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.
Monitor, troubleshoot, and enhance data systems to ensure high availability and performance.
Enforce data quality, security, and governance standards across all solutions.
Document solutions and communicate complex technical concepts effectively, both in writing and verbally.

Required Skills and Qualifications:

Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.
Advanced proficiency in Python for data processing, automation, and integration.
Deep understanding of relational and NoSQL databases, including optimization and management techniques.
Experience with distributed data processing frameworks (e.g., Hadoop, Spark, Flink).
Strong foundation in data modeling, ETL processes, and data warehousing principles.
Excellent written and verbal communication skills, with the ability to convey technical ideas clearly to both technical and non-technical stakeholders.
Detail-oriented, proactive, and self-motivated, thriving in remote and autonomous work environments.

Preferred Qualifications

Prior experience in fast-paced or startup-like environments supporting global teams.
Expertise with cloud-based big data platforms (e.g., AWS, GCP, Azure).
Familiarity with machine learning operations and data science workflows is a plus.
Email

By clicking any of the "Continue" buttons below, you acknowledge and agree to our Terms and Privacy Policy for candidates.

Continue
or
Continue with Google
Continue with LinkedIn

Have any questions? See FAQs

Refer and Earn
$500

Job Tags

For contractors, Remote work

Similar Jobs

Passionately Pets

Pet Sitter & Dog Walker with Flexible Schedule Job at Passionately Pets

Want a flexible job that fits into your day? Join our team of trusted midday dog walkers and pet sitters.What Youll Do* Complete in-home pet care visits* Walk dogs and provide exercise* Feed pets and refresh water bowls* Report any issues or concerns* Ensure... 

United Parcel Service Inc.

UPS Delivery Driver Job at United Parcel Service Inc.

 ...need:The ability to lift up to 70 lbs.Valid drivers licenseno CDL required (License type varies by state)Pass the DOT physical...  ...Benefits:Excellent weekly payGrowth opportunities*Extensive training401(k)Defined-benefit pension planMedical, dental, and vision... 

AFLAC of the Black Hills

Sales Associate - Aflac Job at AFLAC of the Black Hills

 ...Job Description Sales Associate Aflac Join a team that makes a difference and build a career with unlimited potential. Are you a people person who enjoys working in a collaborative team environment? If so, Aflac invites you to explore a rewarding opportunity... 

KBR

Principal Mechanical Engineer - Pressure Vessel Job at KBR

Title: Principal Mechanical Engineer - Pressure Vessel KBR Sustainable Technology Solutions (STS) provides holistic and value-added solutions across the entire asset life cycle. These include world-class licensed process technologies, differentiated advisory services...

AppJaxx

Creative Director Job at AppJaxx

 ...strategy, we deliver predictable and sustainable growth for our clients. As we continue to expand, we are seeking an experienced Creative Director to lead the creative vision of the company and ensure that all brand, marketing, and campaign assets reflect a high standard...