# Managing large data, need to cycle and then summarize

**URL:** https://community.crewai.com/t/managing-large-data-need-to-cycle-and-then-summarize/6513
**Category:** General
**Created:** [July 9, 2025, 10:25am UTC](https://community.crewai.com/t/managing-large-data-need-to-cycle-and-then-summarize/6513 "2025-07-09T10:25:33Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![Matteo\_Zanchi](https://sea1.discourse-cdn.com/flex025/user_avatar/community.crewai.com/matteo_zanchi/32/1971_2.png) [@Matteo\_Zanchi](https://community.crewai.com/u/Matteo_Zanchi)
#### Post date: [July 9, 2025, 10:25am UTC](https://community.crewai.com/t/managing-large-data-need-to-cycle-and-then-summarize/6513/1 "2025-07-09T10:25:33Z")

</div>

Hello

My agents need to process a lot of data. I need to chunk it and then call the kickoff of the crew for every chunk. Then I need to work on the overall result and again I need another crew. Is there any possibility to execute some tasks in a cycles and then other tasks later (all the tasks from the same crew)?

---

<div class="post-metadata">

### Author: ![Tony\_Wood](https://sea1.discourse-cdn.com/flex025/user_avatar/community.crewai.com/tony_wood/32/1876_2.png) [@Tony\_Wood](https://community.crewai.com/u/Tony_Wood)
#### Post date: [July 9, 2025, 4:56pm UTC](https://community.crewai.com/t/managing-large-data-need-to-cycle-and-then-summarize/6513/2 "2025-07-09T16:56:21Z")

</div>

Hi and welcome to the community

A flow might be a good place to start looking [Flows - CrewAI](https://docs.crewai.com/en/concepts/flows) as you can cycle through the data

---

<div class="post-metadata">

### Author: ![Matteo\_Zanchi](https://sea1.discourse-cdn.com/flex025/user_avatar/community.crewai.com/matteo_zanchi/32/1971_2.png) [@Matteo\_Zanchi](https://community.crewai.com/u/Matteo_Zanchi)
#### Post date: [July 10, 2025, 8:31am UTC](https://community.crewai.com/t/managing-large-data-need-to-cycle-and-then-summarize/6513/3 "2025-07-10T08:31:43Z")

</div>

Thanks! I agree, but flows orchestrate crews, that is what I am using. Basically I am forced to use several crews each one with one agent… This is because I can only kick off a crew and I cannot ask agents to execute their tasks and control the flow between the agents inside a crew. The basic use case is summarization of a large document that requries chunking and then merging. I need to chunk (outside of the crew), ask agent 1 to process each chunk, compose the outputs (outside of the crew) and then pass the overall composed result to another agent for finalization. I cannot do this with just 1 crew… am I wrong?

---

<div class="post-metadata">

### Author: ![Tony\_Wood](https://sea1.discourse-cdn.com/flex025/user_avatar/community.crewai.com/tony_wood/32/1876_2.png) [@Tony\_Wood](https://community.crewai.com/u/Tony_Wood)
#### Post date: [July 24, 2025, 10:22am UTC](https://community.crewai.com/t/managing-large-data-need-to-cycle-and-then-summarize/6513/4 "2025-07-24T10:22:31Z")

</div>

When I need control I will use a flow and break it down and do a loop.  
You can try doing it all in one crew but I tend to find they don’t always follow the rules.
