Spark 2.3 streaming to Hbase Write in EMR for IoT sensor

Hello I am working in Bigdata/Hadoop technologies for years. I worked in Hadoop, Mapreduce, Spark (Streaming & MLLib), Kafka, ELK Stack, Cassandra, MongoDB, Postgre. I implemented above using Java Scala and Python. Have worked Shell, Perl and Python Can we talk further on this? Thank you!

I am working as a software developer with 10+ years of experience. Industry experience includes Big Data, Backend, DevOps (AWS and Azure) and etc. I did my MTECH in the Department of Computer Science Engineering, Indian Institute of Technology (IIT) , Guwahati, India. Some of the skills are mentioned below. Amazon Web Services: EC2, Load Balancers, RDS, Elastic Beanstalk, Athena, Glue, EMR IAM, VPC, Security Groups, Cloud Formation, Lambda, S3, CLoudFront, Redshift, Route 53, Cloud Watch, Kinesis, SNS, SQS, API Gateway and etc. Azure: VMs, SQL Databases, Storage and etc. Programming Languages: C, C++, Java, Go, Python, Bash Big Data Technologies: Hadoop, Spark, Hive, HDFS, HBase, Kafka, Flume, Memsql, Aerospike, Redis and etc. Miscellaneous: Algorithms, Data Structures, Distributed Systems, Operating Systems Databases: Oracle, MySQL, SQL Server Operating Systems: Windows, Linux, Ubuntu and etc. Code Deployments: Puppet, Docker, Airflow

I have expertise in Spark streaming with Kafka and storing in Hbase or Hive or HDFS. Your requirement is pretty much same. I am having experience of 4 years in Big Data development only. I am interested in your work and I would like to work with you. Please share more details.

Hi I can do this work for you according to your requirements and with quality. Kindly have a look into my profile. Relevant Skills and Experience I have expertise in Spark pipeline with both batch and streaming Kaffa and lambda architecture Emr, hive hbase etc

I have work experience of 2 years in Big_data field. Work involved Apache Spark getting data from Kafka and storing it into Apache Phoenix. Your work is also similar to what I did and previously. I can complete this work in 3-4 days as per your requirements.

Hello, We are experienced practitioners on Big data, DevOps, Full Stack, and ML. We have very good experience with Spark as we practice Big data using Spark and Spark SQL. Please let us know more about the requirement and we can provide quality delivery. Thanks, RhombusLabs

I am new in freelancer but I have good knowledge of spark streaming, I have received 2 lac events and processed in 3 min batch interval.

please let me know your requirements. I have experience in building data pipeline in spark, Kafka and Cassandra