Nur Kholis M.kholis.hashnode.dev·Sep 27, 2024Flink: Failed to validate any of the configured directories to monitorIssue: Flink Dashboard unable to startup with following error messages: + echo 'Starting Flink History Server' + exec /opt/cloudera/parcels/FLINK-1.16.2-csa1.11.0.1-cdh7.1.9.0-387-45580652/bin/flink-historyserver start-foreground Sep 27, 2024 2:21:45...apache-flink
Nur Kholis M.kholis.hashnode.dev·Nov 28, 2023NiFi - Unable to connect to Kafka with different/weak encryptionIssue KafkaPublish and ConsumerKafka Processor in NiFi with strong encryption (aes128/aes256) cannot connect to Kafka Server with weak encryption (rc4-hmac) with following error: 2023-11-23 14:00:14,523 INFO org.apache.kafka.clients.producer.Producer...28 readsapache nifi
Musaib Shaikhmusaib.hashnode.dev·Sep 28, 2023Transforming Semistructured Data with PySpark and Storing in Hive Using Cloudera ETL.In the vast landscape of data engineering and analysis, one common challenge is to transform the raw semi-structured/unstructured data into meaningful insight. In this blog, we will transform the semistructured data i.e. the CSV file into a structure...135 readsCloudera
Nur Kholis M.kholis.hashnode.dev·Aug 31, 2023Ranger: Bulk add new user for NiFi NodesIssue You need to add many NiFi nodes to be able to grant privileges on NiFi/NiFi Registry Services. Adding manually one-by-one in Ranger UI will take a lot of time. Resolution Use Ranger REST API. Add user Create file ranger-add-user.sh with fol...Cloudera
Timothy Spanntimwithpulsar.hashnode.dev·May 3, 2023Building a Travel Advisory App with Cloudera Data Flow (on Apache NiFi in K8)FLaNK-TravelAdvisory Travel Advisory - RSS Processing - Apache NiFi - Apache Kafka - Apache Flink - SQL Overview Final Flow Adding Processors to the Designer Here I list most of the processors available https://www.datainmotion.dev/2023/04/dataflow...93 readsapachenifi
Sandip Nikalesandiip.hashnode.dev·Jan 23, 2022How to create a custom parcels in cloudera cluster.Many of you might have come across a scenario where you wanted to install a package with a consistent version across all nodes in cloudera cluster, for example, if you want a higher python version on all nodes in the cluster what would you do... It's...56 readsCloudera
