Remote opportunity at
Bright Vision TechnologiesHadoop Solutions Developer
Bright Vision Technologies creates applications designed to automate and optimize business processes. The organization is currently hiring a Hadoop Solutions Developer for a full-time, direct W2…
Career Tools
About This Role
Bright Vision Technologies creates applications designed to automate and optimize business processes. The organization is currently hiring a Hadoop Solutions Developer for a full-time, direct W2 position located in the continental United States. This role operates as part of an in-house Statement of Work engagement without third-party clients, vendors, or brokers involved. The position offers an annual salary ranging from $100,000 to $150,000. The person in this role will design,…
Job Description
Bright Vision Technologies creates applications designed to automate and optimize business processes. The organization is currently hiring a Hadoop Solutions Developer for a full-time, direct W2 position located in the continental United States. This role operates as part of an in-house Statement of Work engagement without third-party clients, vendors, or brokers involved. The position offers an annual salary ranging from $100,000 to $150,000.
The person in this role will design, build, and manage large-scale analytics platforms and data processing pipelines using Hadoop and associated big-data tools. Key duties include processing both structured and unstructured information to support enterprise reporting, machine learning, and analytics. Candidates must complete a mandatory technical coding assessment during the evaluation process. H1B visa transfers are supported for qualified applicants, though new H1B sponsorships are unavailable.
Responsibilities
- Design and operate end-to-end big-data pipelines on Hadoop incorporating diverse data sources
- Construct ETL and ELT workflows utilizing Apache Spark, Hive, Pig, and Sqoop
- Build real-time streaming data pipelines with Kafka, Spark Streaming, or Flink
- Tune Spark and MapReduce jobs for performance and cost efficiency
- Maintain data models and storage layouts across HDFS, Hive, HBase, and lakehouse formats
- Collaborate with security teams to implement data governance and quality controls
- Establish monitoring and alerting strategies for pipeline error detection and SLAs
- Partner with data scientists to supply curated datasets
- Automate pipeline orchestration using tools such as Airflow or Oozie
- Document system architectures, schemas, and operational runbooks
- Mentor junior engineers and contribute to team engineering standards
Requirements
- Five or more years of professional experience operating big-data pipelines on Hadoop
- Hands-on expertise with Apache Spark using Scala, Python, or Java in production
- Working knowledge of Hive, HDFS, Sqoop, HBase, and the Hadoop ecosystem
- Experience with streaming data technologies like Kafka, Spark Streaming, or Flink
- Proficiency in SQL for relational and NoSQL data stores
- Familiarity with workflow orchestration tools such as Airflow or Oozie
- Understanding of distributed systems principles including fault tolerance and partitioning
- Scripting proficiency in Python or Shell
- Completion of a mandatory technical coding assessment
Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related technical discipline
- Experience running Hadoop on cloud platforms like AWS EMR, Azure HDInsight, or Databricks
- Familiarity with lakehouse formats including Delta, Iceberg, and Hudi
- Exposure to data governance tools such as Apache Atlas or Collibra
- Background in Kubernetes-based data platforms
- Hands-on experience with CI/CD and infrastructure-as-code workflows
Core Skills
Frequently Asked Questions
Answers are based only on the employer’s listing; where it doesn’t say, neither do we.
What is the location or remote policy for this role?
The position is 100% remote within the continental United States.
What is the employment type and compensation?
This is a full-time, direct W2 position offering an annual salary between $100,000 and $150,000.
Does Bright Vision Technologies support visa transfers?
New H1B sponsorships are not available, but candidates currently on a valid H1B visa who require a transfer may apply and will receive support if qualified.
How can I apply for this position?
Candidates can apply by sending their resume to the contact email or calling the phone number provided in the posting.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.