Senior Big Data Engineer

August 30, 2019
Richland, WA
Job Type


Big Data Engineering addresses critical national and global issues by developing data processing/storage systems utilizing cloud, parallel and distributed architectures. We provide high-performance extract-transform-load processing and big data services capabilities supporting high velocity streaming systems, large data sets, applied real-time analytics and artificial intelligence


The ideal candidate is a software engineer with substantial Big Data experience and understands the methods and pitfalls of working with Big Data. These engineers will design, develop, document, test, and debug new and existing software systems, hardware/software interfaces, and/or applications according to industry established software engineering principals and best practices. Senior engineers work and lead collaboratively within a team to execute on the full system development lifecycle including analyzing sponsor needs to determine technical requirements; developing technical specifications based on conceptual design and requirements; developing well-crafted and documented source code; integrating hardware using software; automating manual tasks; and consulting with the end user to prototype, configure, refine, test, and debug programs or systems to meet needs.


The ideal candidate will also possess qualities such as:

  • An interest, curiosity and technical depth to support the development and advancement of a variety of applied problems specific to the national security community
  • The ability and the desire to learn new technologies as this is a rapidly evolving field
  • Technical knowledge in configuring and deploying applications in multiple environments – cloud, container services, clusters
  • Contribute to the technical content of proposals and technical products such as journal and conference publications technical presentations, and software releases will be expected. Must possess excellent verbal and written communication skills


The Big Data Engineer should have working knowledge in several of the following related-skillsets:

  • Substantial experience programming in at least one object-oriented programming language such as Java, C#, C++ or Python
  • Knowledge of software engineering best practices and software project lifecycles
  • Working knowledge of Big Data best practices
  • Working with both streaming and batched data
  • Choosing the right technology for a specific scenario (NoSQL vs RDBMS, Spark vs Storm vs MapReduce, AWS EC2 vs AWS Lambda)
  • Scaling vertically vs horizontally
  • Acquiring/integrating data within a distributed environment (e.g., AWS, Azure, GCP, OpenStack, Hadoop)
  • Data pipeline development (e.g., Spark, NiFi, Kafka, AWS Glue, Kinesis)
  • Data cleansing (Bash, Python, etc)
  • Scalable/massively parallel databases (Hive, Redshift, Impala, Athena)
  • NoSQL databases and cache/indexing services (e.g., Elasticsearch, DynamoDB, HBase, MongoDB, Redis)


Minimum Qualifications

  • Bachelor's degree in computer science or closely related field with strong software design and development skills with 5 years' experience or a master’s degree with 3 years' experience, or a Ph.D. with 1 years’ experience is required

Related Jobs

Scrum Master   Tampa, FL new
February 21, 2020
Mechanical Design Engineer   Phoenix, AZ new
February 19, 2020
Senior Information Security Engineer   Clearwater, FL new
February 11, 2020
Sr Security Analyst   Orlando, FL new
February 11, 2020
February 6, 2020
This entry was posted in . Bookmark the permalink.