Big Data Developer
Location: Syntelli’s North Carolina office
13925 Ballantyne Corp. Place, Suite 260, Charlotte, NC 28277
Key Responsibilities
-
Develop customized enterprise-level software applications designing and architecture to satisfy the needs of the finance and insurance domains;
-
Perform technical requirement analyses of the various stakeholders;
-
Develop and analyze application design (preparing functional specification documents and technical design documents with the best suitable architectural decisions for complex business requirements);
-
Review architecture and design artifacts and estimate efforts for each requirement (create logical and sequence diagrams, create use-case diagrams, create architecture and development diagrams, etc.);
-
Access quality of data sets and maintain integrity through Ingestion framework; troubleshoot and debug Hadoop ecosystem run-time issues; integrate data from multiple data sources and establish efficient ETL framework through Spark/Pyspark/Scala/Kafka; develop Scala scripts using Spark, Pyspark, Kafka to run Spark Jobs in Hadoop HDFS Cluster; data modeling and data mapping (design logical and physical data models, create entity relationships, map reference data, etc.);
-
Support production environment availability and bug fixing of production issues; create and automate application builds and deploy scripts; manage application development life-cycle and generate customized reports monitoring application.
Minimum Requirements
Education and Experience: Masters’ degree in Computer Science/Applied Computer Science, Computer Engineering, Computer Applications, Information Technology, or Computer Information Systems. Alternatively, Bachelors’ degree in Computer Science/Applied Computer Science, Computer Engineering, Computer Applications, Information Technology, or Computer Information Systems plus 5 years’ experience as Software Developer, Technical Architect, BI Architect, Programmer, or related position.
Skills
- Pyspark, Scala, Java, PL/SQL
- Hadoop, HDFS, Map Reduce, HBase, Pig, Hive, Sqoop, Spark, Kafka, Apache NiFi, Oozie, Hue, Impala
- Oracle 9i/10g, Db2, Netezza,
- Unix/LINUX, Windows
- IntellIJ, Jupiter Notebook, PyCharm , Eclipse
- TOAD, SQL Developer
- SBT, Maven, Gradle, Ant
- Investment Banking and Finance, Annuities and Life Insurance domains
- Autosys, JIRA, GIT
Key benefits, currently, are
- Benefits – 401k
- Healthcare, dental and vision
- 401K: 100% match up to 5% of your contribution. No vesting period
- Six paid holidays, week between Christmas and New Year PTO, and two additional weeks of PTO
- Other benefits include gym membership (select gyms) for primary member and discounted for family etc.
- This position qualifies under our incentive-based employee referral program.
