Senior Distributed Systems Engineer (background should include significant experience in scalable distributed systems)
Cloudera based in Palo Alto, Ca is looking for a Senior Systems Engineer who wants to own major components of our data processing platform designed for petabytes of data. You will be dedicated to systems architecture, capacity, security, stability, and data flow issues throughout our high performance data pipelines. An analytical approach with deep understanding of all computer system layers is critical for success in this role.
Responsibilities
Build large distributed systems that scale well – to petabytes of data and tens of thousands of nodes.
Understand performance bottlenecks, failure points, and security holes in such large scale systems, then design and implement software that avoids them.
Develop tools that automate the operations, administration, and tuning of large Hadoop clusters.
Develop tools that facilitate the tuning, development, debugging, and profiling of jobs running on such large clusters.
Develop tools to enable the development and optimization of data work flow pipelines on top of Hadoop clusters.
Profile and optimize large Hadoop clusters, at the application, operating system, file system, server and network levels.
Administer application- level knowledge of back-end systems architecture, as well as contribution to the overall design to monitor and sustain our high standards of availability, security and performance
Qualifications
4+ years software development experience with a highly-scalable, distributed, large multi-node environment (1000+ nodes)
6+ years of Unix environment experience (Red Hat Linux, FreeBSD) including shell scripting
Extensive software development experience in C++, Java, and Python (Django is a strong plus)
Custom network monitoring and application instrumentation experience
System performance debugging and kernel forensics experience
Strong troubleshooting and performance tuning skills (TCP/IP, DNS, File system, Load balancing, etc)
Sufficient understanding of Grid computing, Map-Reduce, advanced server clustering and distributed programming
Strong knowledge of RDBMS concepts and SQL
Knowledge of file system, kernel and database internals – latency, throughput, reliability, availability, consistency, security, etc.
Familiarity with the issues surrounding cross data center replication.
Familiarity with virtual machine technologies
Systems monitoring and management for grid computing.
Provisioning and operating a large-scale compute/storage systems.
Working knowledge of distributed file systems (development knowledge is a strong plus).
Excellent communication skills
Cloudera is a leader in the innovative technology of Hadoop and growing rapidly. We offer a very competitive salary and valuable stock options in our firm. If you are truly striving to make a difference in technology, take on major challenge, and advance your career, please send your information to herbnj@gmail. com
Cloudera based in Palo Alto, Ca is looking for a Senior Systems Engineer who wants to own major components of our data processing platform designed for petabytes of data. You will be dedicated to systems architecture, capacity, security, stability, and data flow issues throughout our high performance data pipelines. An analytical approach with deep understanding of all computer system layers is critical for success in this role.
Responsibilities
Build large distributed systems that scale well – to petabytes of data and tens of thousands of nodes.
Understand performance bottlenecks, failure points, and security holes in such large scale systems, then design and implement software that avoids them.
Develop tools that automate the operations, administration, and tuning of large Hadoop clusters.
Develop tools that facilitate the tuning, development, debugging, and profiling of jobs running on such large clusters.
Develop tools to enable the development and optimization of data work flow pipelines on top of Hadoop clusters.
Profile and optimize large Hadoop clusters, at the application, operating system, file system, server and network levels.
Administer application- level knowledge of back-end systems architecture, as well as contribution to the overall design to monitor and sustain our high standards of availability, security and performance
Qualifications
4+ years software development experience with a highly-scalable, distributed, large multi-node environment (1000+ nodes)
6+ years of Unix environment experience (Red Hat Linux, FreeBSD) including shell scripting
Extensive software development experience in C++, Java, and Python (Django is a strong plus)
Custom network monitoring and application instrumentation experience
System performance debugging and kernel forensics experience
Strong troubleshooting and performance tuning skills (TCP/IP, DNS, File system, Load balancing, etc)
Sufficient understanding of Grid computing, Map-Reduce, advanced server clustering and distributed programming
Strong knowledge of RDBMS concepts and SQL
Knowledge of file system, kernel and database internals – latency, throughput, reliability, availability, consistency, security, etc.
Familiarity with the issues surrounding cross data center replication.
Familiarity with virtual machine technologies
Systems monitoring and management for grid computing.
Provisioning and operating a large-scale compute/storage systems.
Working knowledge of distributed file systems (development knowledge is a strong plus).
Excellent communication skills
Cloudera is a leader in the innovative technology of Hadoop and growing rapidly. We offer a very competitive salary and valuable stock options in our firm. If you are truly striving to make a difference in technology, take on major challenge, and advance your career, please send your information to herbnj@gmail. com
No comments:
Post a Comment