You can add arbitary data as files to IPFS, and then add their CID as a field to your json. Then peers in the network can decide whether to fetch that CID or not