Ask Your Question
0

Field Remover - incorrect behaviour

asked 2018-08-03 01:51:29 -0500

dyziu gravatar image

Hi everyone, I hope you could help me with one simple issue. I've started playing around with StreamSets. Very nice tool but I have faced at the beginning with box “Field Remover”. It’s not working properly as I want (maybe some restrictions I don’t know or that way I am doing it’s not allowed). First I would like to use HTTP Client to connect with REST API ( http://api.football-data.org/v2/compe... ). In the output, I have a list with 24 fields (I want to remove 21 or keep 3). After that, I am using the box Field Remover. In Option, I can pick up Keep Listed Fields. I mark 3 fields I want to keep but unfortunately, in output in this box, I have a list with 9 fields, instead of 3. The same happens if I choose Remove Listed Fields, Mark 21 fields I want to remove. Still, in the output, I can see 9 fields.

edit retag flag offensive close merge delete

Comments

I doubt if the changes you made to your configuration did not change before you ran! I suggest you to reconfigure and double check if the changes reflected in your configurations and try running the pipeline.

Maithri gravatar imageMaithri ( 2018-08-06 01:30:21 -0500 )edit

1 Answer

Sort by » oldest newest most voted
0

answered 2018-08-06 01:45:20 -0500

Maithri gravatar image

updated 2018-08-07 04:48:03 -0500

1) Action: Keep listed fields

Fields: /field1name /field2name

type the fileldname as /fieldname and press enter before you mention the next field name.

2) Action:Remove listed fields

Fields: /field1name /field2name

type the fileldname as /fieldname and press enter before you mention the next field name.

image description

image description

For list fields:

image description

image description

edit flag offensive delete link more

Comments

Hi, thank you for a reply. I did all these steps as you mention it. Still, it doesn't work. It works incorrectly when I want to leave less than a half or remove more than a half of fields.

dyziu gravatar imagedyziu ( 2018-08-07 02:56:46 -0500 )edit

i have added configuration for list fields in the answer

Maithri gravatar imageMaithri ( 2018-08-07 04:48:37 -0500 )edit

I cannot attach a file, https://paste.ofcode.org/enVk7MvXj28Bgz77XXehVR I exported my pipeline. Could you check if it works?

dyziu gravatar imagedyziu ( 2018-08-07 05:08:16 -0500 )edit

You can use https://streamsetters.slack.com/ to discuss the issues

Maithri gravatar imageMaithri ( 2018-08-07 07:38:36 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-08-03 01:51:29 -0500

Seen: 58 times

Last updated: Aug 07