Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

HDFS to kinesis,getting null records

Trying to push HDFS Orc file to Kinesis with SDC as Target data type .SS logs doesn't show any error but when I try get the records from the stream ,resulting null .

HDFS to kinesis,getting null records

Trying to push HDFS Orc file to Kinesis with SDC as Target data type .SS logs doesn't show any error but when I try get the records from the stream ,resulting null .

HDFS to kinesis,getting null records

Trying to push HDFS Orc file to Kinesis with SDC as Target destination data type .SS logs doesn't show any error but when I try get the records from the stream ,resulting null .

log : [2019-04-10 18:11:42.798569] [0x000163dc][0x00007ff99dd58700] [info] [shard_map.cc:79] Updating shard map for stream "tds.dmr.busmap_event" [2019-04-10 18:11:42.831412] [0x000163dc][0x00007ff98b7fe700] [info] [shard_map.cc:144] Successfully updated shard map for stream "tds.dmr.busmap_event" found 1 shards

sending no-more-data event. records 1 errors 0 files 1

HDFS to kinesis,getting null records

Trying to push HDFS Orc file to Kinesis with SDC as destination data type .SS logs doesn't show any error but when I try get the records from the stream ,resulting null .

log : [2019-04-10 18:11:42.798569] [0x000163dc][0x00007ff99dd58700] [info] [shard_map.cc:79] Updating shard map for stream "tds.dmr.busmap_event" [2019-04-10 18:11:42.831412] [0x000163dc][0x00007ff98b7fe700] [info] [shard_map.cc:144] Successfully updated shard map for stream "tds.dmr.busmap_event" found 1 shards

sending no-more-data event. records 1 errors 0 files 1

HDFS ORC data format to kinesis,getting Kinesis; getting null records

Trying to push HDFS Orc file ORC files to Kinesis with SDC Record as destination data type .SS type. StreamSets logs doesn't don't show any error errors but when I try get the records from the stream ,resulting null .stream, there are none.

log :
[2019-04-10 18:11:42.798569] [0x000163dc][0x00007ff99dd58700] [info] [shard_map.cc:79] Updating shard map for stream "tds.dmr.busmap_event"
[2019-04-10 18:11:42.831412] [0x000163dc][0x00007ff98b7fe700] [info] [shard_map.cc:144] Successfully updated shard map for stream "tds.dmr.busmap_event" found 1 shards

shards

sending no-more-data event. records 1 errors 0 files 11

I'm using standalone Hadoop FS with whole file data file type; Kinesis destination with SDC Record data file type.

HDFS ORC data format to Kinesis; getting null records

Trying to push HDFS ORC files to Kinesis with SDC Record as destination data type. StreamSets logs don't show any errors but when I try get the records from the stream, there are none.

log :
[2019-04-10 18:11:42.798569] [0x000163dc][0x00007ff99dd58700] [info] [shard_map.cc:79] Updating shard map for stream "tds.dmr.busmap_event"
[2019-04-10 18:11:42.831412] [0x000163dc][0x00007ff98b7fe700] [info] [shard_map.cc:144] Successfully updated shard map for stream "tds.dmr.busmap_event" found 1 shards

sending no-more-data event. records 1 errors 0 files 1

I'm using standalone Hadoop FS with whole file data file type; Kinesis destination with SDC Record data file type.