I want an AI that knows the whole company: what data is needed?

You need reliable, authorized sources: procedures, manuals, price lists, documents, CRM, databases, and business rules. First we classify data by department and sensitivity, remove outdated versions, and define permissions. The AI doesn't necessarily need to "see everything": it should only retrieve what's relevant to the role and the question.