How to implement PDF as a knowledge source?

[Daniel_Ryan]

Hi @Sudesh_K

I was having the same issue. I believe there is a bug see:

[BUG] Knowledge Source metadata generation doesn't work (and possibly the knowledge store at all)

So, i’ve been fighting to use the crewAI docs as the knowledge source for the crew. Meanwhile, found out following errors: StringKnowledgeSource accepts a single string a knowledge source, breaks it in chunks, but does not generates the metadata for the chunks, however requires it. This, producing errors like: [WARNING]: Failed to init knowledge: Unequal lengths for fields: ids: 487, metadatas: 1, documents: 487 in upsert. when used as: StringKnowledgeSource( co…

In this BUG post, @opahopa prepared their own temporary fix. By creating their own LocalTxTFileKnowledgeSource Class.

My solution was to convert my .pdf file to a .txt file first. Then use this LocalTxTFileKnowledgeSource class instead.