Hello
My agents need to process a lot of data. I need to chunk it and then call the kickoff of the crew for every chunk. Then I need to work on the overall result and again I need another crew. Is there any possibility to execute some tasks in a cycles and then other tasks later (all the tasks from the same crew)?
Hi and welcome to the community
A flow might be a good place to start looking Flows - CrewAI as you can cycle through the data
Thanks! I agree, but flows orchestrate crews, that is what I am using. Basically I am forced to use several crews each one with one agent… This is because I can only kick off a crew and I cannot ask agents to execute their tasks and control the flow between the agents inside a crew. The basic use case is summarization of a large document that requries chunking and then merging. I need to chunk (outside of the crew), ask agent 1 to process each chunk, compose the outputs (outside of the crew) and then pass the overall composed result to another agent for finalization. I cannot do this with just 1 crew… am I wrong?
When I need control I will use a flow and break it down and do a loop.
You can try doing it all in one crew but I tend to find they don’t always follow the rules.