Throttling FTP Polling consumers using apache camel -


i have requirement in @ 1 point of time, need connect multiple ftp/sftp endpoints (say 100 ftp endpoints) download files , process them.

i have route below. seda queue further processes messages moving them appropriate folders

from(ftp://username@host/foldername?password=xxxxx&include=.*).to("seda:"+routeid)  

now if starting ftp endpoints @ same time, resulting in jvm memory issues. how throttle starting of ftp endpoints? can use seda before ftp throttle (if how can use it)? other eip's or ideas use throttle triggering of polling ftp consumers?

you can throttler dsl if want throttle fetching of messages. http://camel.apache.org/throttler.html

for controlling startup can simplescheduleroutepolicy.. http://camel.apache.org/simplescheduledroutepolicy.html

it handles route activating , deactivating. although haven't used myself looks can perhaps add controlled delay on when routes should start , stop.


Comments

Popular posts from this blog

Load Balancing in Bluemix using custom domain and DNS SRV records -

oracle - pls-00402 alias required in select list of cursor to avoid duplicate column names -

python - Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>] error -