Jim Irsay, the owner and CEO of the Indianapolis Colts, died in his sleep Wednesday afternoon, the team announced.