Throttling FTP Polling consumers using apache camel -
i have requirement in @ 1 point of time, need connect multiple ftp/sftp endpoints (say 100 ftp endpoints) download files , process them.
i have route below. seda queue further processes messages moving them appropriate folders
from(ftp://username@host/foldername?password=xxxxx&include=.*).to("seda:"+routeid)
now if starting ftp endpoints @ same time, resulting in jvm memory issues. how throttle starting of ftp endpoints? can use seda before ftp throttle (if how can use it)? other eip's or ideas use throttle triggering of polling ftp consumers?
you can throttler dsl if want throttle fetching of messages. http://camel.apache.org/throttler.html
for controlling startup can simplescheduleroutepolicy.. http://camel.apache.org/simplescheduledroutepolicy.html
it handles route activating , deactivating. although haven't used myself looks can perhaps add controlled delay on when routes should start , stop.
Comments
Post a Comment