It means the material is fragile and can break/collapse easily. For example, some cookies are brittle because they flake off when you touch them.
Hope I could help! :)
9.5m questions
12.2m answers