Hortonworks jobs
... rn rn rn Role: Hadoop Developer / Admin with Production SupportLocation: Austin, TXDuration: 12 Months Job Description: We are looking someone having strong experience in production support, administration and Development experience with Hadoop technologies.• Minimum Experience 8 Years• Must have Hands-on experience on managing Multiple Hortonworks Clusters. Troubleshooting, Maintaining and Monitoring is the key responsibility here.• Must be conversant in HBase, OpenBSD & Grafana related issues handling in order to ensure the data flow is smooth and consistent.• Experience on Kafka for stream processing of Data• Experience in Deployment of new services, patching of hosts etc.• ...
We have a pre-build product which is stored in private GitHub repository. A documentation would be provided to assist to install product which would require you to install HDP on Ubuntu on a AWS EC2 instance. In addition you would also install MongoDB and few other applications. host the our product/application (checked in GitHub repository). The document would provide you step-by-step guide install, configure the CDH, external applications, plugins and Spring Boot built Java applications. Any support needed in Java would be provided. Please contact us if you are interested in this kind of work.
Job description Key Responsibilities · Understanding Business Requirements and Functional Requirements provided by Architect to develop & deploy the Spark and Java based solutions well within timelines. · Design and development of a...experience working with extremely large data volumes is mandatory. • Experience in Agile SDLC and AWS is a must. • Product development experience is a must • Expertise in ETL and data wrangling using Java • Experience in programming in Linux/Unix environment, including shell scripting • Excellent troubleshooting skills • Spark Developer certification from any of (Databricks, MAPR, Cloudera or Hortonworks etc) would be a plus. Educational Qualifications • Bachelor’s degree in C...
...translate clients’ business challenges and concerns into a solution oriented discussion. Must Have: ● At least 6+ years of total IT experience ● At least 4+ years of experience in design and development using Hadoop technology stack and programming languages ● Hands-on experience in 2 or more areas: o Hadoop, HDFS, MR o Spark Streaming, Spark SQL, Spark ML o Kafka/Flume. o Apache NiFi o Worked with Hortonworks Data Platform o Hive / Pig / Sqoop o NoSQL Databases HBase/Cassandra/Neo4j/MongoDB o Visualisation & Reporting frameworks like D3.js, Zeppellin, Grafana, Kibana Tableau, Pentaho o Scrapy for crawling websites o Good to have knowledge of Elastic Search o Good to have understanding of Google Analytics data streaming. o Data security (Kerberos/Open LDAP/Knox/Ranger) ...
Data Engineers 6+ yrs : At least 6+ years of total IT experience ● At least 4+ years of experience in design and development using Hadoop technology stack and programming languages ● Hands-on experience in 2 or more areas: o Hadoop, HDFS, MR o Spark Streaming, Spark SQL, Spark ML o Kafka/Flume. o Apache NiFi Worked with Hortonworks Data Platform o Hive / Pig / Sqoop o NoSQL Databases HBase/Cassandra/Neo4j/MongoDB o Visualisation & Reporting frameworks like D3.js, Zeppellin, Grafana, Kibana Tableau, Pentaho o Scrapy for crawling websites o Good to have knowledge of Elastic Search o Good to have understanding of Google Analytics data streaming. o Data security (Kerberos/Open LDAP/Knox/Ranger) ● Should have a very good overview of the current landscape and ability t...
We need to hire a Hadoop and Spark expert. Tasks to be done: - Configure properly Hadoop cluster in HA mode - Configure properly Spark cluster in HA mode - Install and configure HBase - Install and conf...cluster in HA mode - Install and configure HBase - Install and configure Oozie - Install and configure SSL for all the tools mentioned above. - Configure authentication for all the tools mentioned above. Installation will be done in an on-premise environment. Linux based OS (centos 9) will be used. All the Hadoop and Spark software will be the full open source version. We are not using Cloudera, Hortonworks, MapR or similars. Project will be payed by an hourly rate for the amount of time it takes to finish the tasks mentioned above. Only tech folks with experience will be cons...
...for a graphic artist who can create logo for new startup company. Please see below requirements detail: Company Name: Big Panda Analytics Private Limited Business detail: IT Consulting services in the field of Artificial Intelligence, Machine Learning, Big data & Analytics Logo inspiration: imagine pandas instead of elephants. Imagine Big Panda instead of text Hortonworks. Imagine the punch line on the line of "Think Data, Think Big Panda" instead of powering the future of data. Panda images inspiration: The above inspirations are to fuel your imagination and motivation. Logo requirement: visually appealing & professional aesthetic. When you provide samples, at least 1-2 sets should be based on above inspiration theme
...deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name node high availability, schedule and configure it and take backups. Good knowledge of Linux as Hadoop runs on Linux. Familiarity with open source configuration management and deployment tools such as Puppet or Chef and Linux scripting. You will be preferred if: Cloudera and Hortonworks Certified Engineer AWS Big Data Pro Certification Extensive migration and troubleshooting experience. Mactores provides equal opportunity in all of our employment practices to all qualified employees and applicants without regard to race, color, religion, gender, national origin, age, disability, marital status, military status, genetic information or any other category p...
Requirement Nifi Spark Kafka Elastic search MINIO Java Spring boot Hortonworks sandbox same like cloud era Role : Part Time Hours : 3 hrs a day Monday to Friday Payment : weekly
Need help in installation of horton works sandbox in windows virtual box.
Hi Sandeep, I am Prashant Gupta, very interested to make a good career with your esteemed organization. Below are my brief details for your consideration. Experience: 6+ years of overall IT experience and 3.4 years Hands on experience as a Big Data Hadoop Administrator in MapR and Hortonworks Distribution. Current Company: TCS Pvt. Ltd., Bangalore Current Role : I.T. Analyst Proficient-in: Hadoop, HDFS, Hive, Pig, Mapreduce, Oozie, Sqoop, Hbase, Ranger, Kerberos, MySql, Nifi. Qualification: BE, ECE(2013) with 64.% Current Location : Bangalore Please consider my application for this suitable opportunity in Hadoop Admin. Thanks & Regards, Prashant Gupta Mobile: (+91) 9406842909 Email: @
Your Profile: - You are available to work on a problem with 24 hours of notice - You are expert in Spark (Scala) - You are expert in Jenkins (job scheduling) - You are expert in GitLab - You are expert in AWS EMR - You know enough AWS Athena - You speak and Understand English very well
Can we install Ambari and Hortonworks without having need of cloudera credentials?
using hortonworks, map reduce. or Python and need report i will give the details later.
I need you to design and build it. due date 20 September
Looking for Hadoop Admin for long term project. Must know about setting up cluster in cloudera and Hortonworks and troubleshooting. Looking for someone that can stay with me for long term project. Looking for the following skill sets. 1)Kakfa 2)Java 3)Cloudera installation and troubleshooting 4)Knows about batch processing 5) Installation of hadoop,kafka,spark and knowledge about data lake
I have some tasks to be done in a few weeks: Atlas metadata auto-synchronization issue resolution Deploy Ranger for Governance Policies and Access Control Implement Ambari View as Hue replacement.
I want ansible scripts to build Horton works cluster with Ambari agent and server, All the services should be deployed using the blueprint.
I have my HortonWorks Cluster on Azure. I want to integrate my Apache Spark logs(YARN logs) with Azure LogAnalytics workspace monitor
Need support for hortonworks hadoop admin work. Install and configure Kerberization with centrify TLS/SSL configuration parameter tuning.
HDP 3.1 integration with secure AD using ssl, Ranger and Knox configuration
Create a simple producer and consumer app to work with Azure Event Hub with Avro Ref : The app should use Hortonworks schema registry to manage Avro
Help me with Hortonworks setup with all necessary ecosystem like Hive, Nifi, Kafka, Kerberos in AWS cluster. And need to provide hands-on support to do same by my own. You can use my AWS account
Create tested step-by-step instructions to create a Hadoop cluster on (2) Windows 7 PC's using VIRTUALBOX and a correctly and tested modified version of the latest Hortonworks "Sandbox" image. Provide a copy of the modified Sandbox image via Dropbox or Google Drive
I need a single bash script that can install Horton Works data platform with all the components on ubuntu 16.04.
Hi, I had worked as a Linux/Unix System Administrator for 2 years and now I am looking for a change to my career to work as a Hadoop Admin. I have a basic understanding of HDFS(Namenode, Datanode, Trackers). Want to know what are the daily tasks, a Hadoop Admin does with enterprise clusters, what tools do they interact with, how to setup a big ...understanding of HDFS(Namenode, Datanode, Trackers). Want to know what are the daily tasks, a Hadoop Admin does with enterprise clusters, what tools do they interact with, how to setup a big data cluster and add services to it such as Hive, zookeper, Oozie etc. I am specifically looking for a guy who have experience in hadoop ecosystem, who can give a brief class for 2-3hrs (1Hr sessions). Platform- Hortonworks distrbution(Ambari Manager) ...
We need help in converting our Kafka cluster to Docker images and depl...server 2. A Readme file that documents how to run these dockers to join and scale in the existing Kubernetes cluster, and any changes required to the Kubernetes configuration Notes: 1. There is no HDFS or any other Hadoop services running in the cluster other than Kafka and Zookeper. The preference is for setting up a stand-alone Kafka cluster (without using any commercial distributions like HortonWorks or Cloudera). 2. Kafka brokers should be available from outside. i.e., data can be pushed and pulled from any network into and from the Kafka brokers. 3. We will provide you the non-Docker installation scripts that we are currently using to setup and configure Kerberos server Versions Kafka: 1.0 Host OS: CentO...
Storing, Querying, MapReduce using HortonWorks Sanbox
Storing, Querying and MapReduce using hadoop (HortonWorks Sandbox)
Hi , I am looking for hadoop administrator training for 5-6 hours who can install hortonworks or mapr and demo to us for personal use. i am planning to host a virtual machine on google cloud for this training. This is purely for personal learning not for any corporate training/work. Looking forward to hear from the trainers. Thanks, Abdul
UpGrad is looking for a Big Data/Cloud systems freelancer who can work to resolve student issues in our Big Data Engineering program. Here is the list of basic requirements for the role: - 3-6 years of experience - Strong Linux/Unix background - Experience in sizing and designing a Hadoop Cluster on AWS - Building and Operating Big data clusters (EMR, Hortonworks, Cloudera, etc.) - Performance benchmarking and performance-tuning of Hadoop Clusters - Installing and configuring Hadoop ecosystem components like Sqoop, Spark, Spark2, Hive, Kafka, Oozie, HBase, and Zeppelin - Experience with Hadoop Security - Kerberos, Ranger, Knox, Data Encryption - Troubleshooting in Java environment This role will require work on weekends. Above all, we're looking for a passion for education, a...
I can provide support for Hadoop/Big Data Administration and help you with ongoing projects. - Well Experienced in Big Data (Hadoop | Kafka | Spark | NoSQL | Elasticsearch | Cloud) Administration and Platforms to Accommodate the Expanding Business Needs. - Well Experienced in Different Vendors (Hortonworks, Cloudera, MapR, etc) of Big Data and Cloud. - Big Data Capacity Planning, Tuning, Solution Architecting, Issue Resolution, and Security. - Big Data Analytics Solution Architecture, and its Implementation.
I am looking for a experts in Kerberos setup and Configuration. I have a Hortonworks cluster running on multiple VMs. The cluster has to be secured using Kerberos. All the services and pipeline are to run seamlessly after the setup. A knowledge transfer will have to be undertaken after it is completed. Services present: 1. HDFS 2. Yarn 3. Map Reduce 4. Zookeeper 5. Kafka 6. Spark2 7. Zeppelin 8. Ambari Metrics.
For an existing Hortonworks installation: 1. Fix start up/restart issue with the environment. Some services do not start on restart. 2. Install HSC (HBase Spark Connector) in the landscape.
Hi, I have 20 years for OS, DB Administration experience. I am new to Hadoop Hortonworks Ambari, will it be possible to you to train me or help me at work for hourly rate. Please let me know if any “Hadoop Hortonworks Ambari Administrator” available. Thanks
...developing solutions with one of the big three Hadoop vendors Experience with either Java or Scala Experience with DevOps software and techniques (containerization: K8s, Puppet, etc., CD/CI: Jenkins, Travis CI, etc.) Experience with *ix shell scripting Freelance software development is your primary source of income Preferred Experience with Python in addition to Java or Scala Experience with the Hortonworks Hadoop Distribution Willingness to travel...
Need some training from an experienced professional on Big Data, Hortonworks data platform, Hadoop, getting data and running queries on HDP etc
VENDOR will provide Services described above and create following deliverables: 1. Assessment and Implementation of Hadoop Data Lake (Work Package A) a. Working environment – fully operational and working Hadoop analytics platform on AWS testing environment b. Initial System Account set-up c. Acceptance Testing as outlined below: i. Working Hive SQL on Hadoop ii. ODBC access iii. Validate software installed thru Ambari portal iv. Verification of installation documentation ...
6-8-year experience with 4-5-year big data. Extensive hands on experience in Hortonworks Hadoop, Spark, Hive ETL, Data flow and pipeline in Hadoop stack. Spark and associated programming (Scala, Python or R) Hive (including optimization). Data Modeling and SQL Preferred experience in stream processing, NIFI, web service and security integration. Experience in Agile development
Need to migrate/resolve errors that are currently showing in current cluster of Hortonworks.
I am looking for Hadoop admin trainer using Hortonworks or Cloudera with the expert level on Google cloud or AWS and I can pay well enough and hence it's very urgent requirement for me if someone can help me in this it will be great.
...the telecom network, process it, find anomalies, initiate actions and present the data (embedded analytics). We have great experience in the R&D team in the areas of telecom software development and telecom data (e.g. CDR) processing in general. It is in the areas of big data storage / processing and anomaly detection in big data where we need help from an external expert. We plan to use Hortonworks Data Platform (HDP) based on Apache Hadoop and it is in this area we are looking for a skilled senior consultant (developer & architect) who has implemented such solutions and has expertise within areas like: - Cluster setup and management - Spark processing jobs - Performance optimization - … We will enter the design phase now and we are open for different ...
I have a data flow setup using Apache NiFi (with Hortonworks Data Flow). It is processing around 100 messages per second but I am seeing high latency and poor speeds. I want someone to optimize the data flow and speed it up to <50 ms latency end to end. Must have expertise in Apache NiFi and the Hortonworks Data Flow stack. Bonus if you have experience in developing dashboards for the realtime data. If so I have additional work to grant. Thanks,
Project in Frankfurt Germany Duration: ASAP - until the end of June 2018 - extension possible Skills: Hadoop Hortonworks Administration Nice to have : knowledge on MariaDB und IBM DB2 (IBM BigSQL) Banking Enviroment Daily Rate all inclusive (Removed by Freelancer.com Admin)
i need a guy for deploying hadoop cluster on aws cloud, i want 2 clusters with hortonworks distribution, also i want 5 nodes in production and 3 nodes in test cluster, i need some services too, like hive pig, flume and sqoop, on daily basis i am having 2 gb of data injection, i need help in capacity planning too
Greetings from Spring People! SpringPeople is one of the biggest Corporate Training vendors in India, delivering 100s of classes every quarter to companies like Cisco, TCS, Cognizant, MindTree, Intuit, Thompson Reuters, Sapient etc. We are official training delivery partners for Pivotal, Elastic, Hortonworks, Lightbend, Mulesoft, EMC, VMware (and more). SpringPoeple has won the leading corporate training company of the year award at ​"India Excellence Summit 2017". To fulfill the constant training demand from our customers, we are looking for subject matter experts and trainers - like yourself. We are looking forward for a fruitful association with you. If you are interested in Delivering the Training on IBM WebSphere ...
Greetings from Spring People! SpringPeople is one of the biggest Corporate Training vendors in India, delivering 100s of classes every quarter to companies like Cisco, TCS, Cognizant, MindTree, Intuit, Thompson Reuters, Sapient etc. We are official training delivery partners for Pivotal, Elastic, Hortonworks, Lightbend, Mulesoft, EMC, VMware (and more). SpringPoeple has won the leading corporate training company of the year award at ​"India Excellence Summit 2017". To fulfill the constant training demand from our customers, we are looking for subject matter experts and trainers - like yourself. We are looking forward for a fruitful association with you. If you are interested in Delivering the Training on Risk Managemen...