It means the material is fragile and can break/collapse easily. For example, some cookies are brittle because they flake off when you touch them.
Hope I could help! :)
8.8m questions
11.4m answers