The construction of three-dimensional covalent organic frameworks (3D COFs) has proven to be very challenging, as their synthetic driving force mainly comes from the formation of covalent bonds. To facilitate the synthesis, rigid building blocks are always the first choice for designing 3D COFs. In principle, it should be very appealing to construct 3D COFs from flexible building blocks, but there are some obstacles blocking the development of such systems, especially for the designed synthesis and structure determination. Herein, we reported a novel highly crystalline 3D COF (FCOF-5) with flexible C–O single bonds in the building block backbone. By merging 17 continuous rotation electron diffraction data sets, we successfully determined the crystal structure of FCOF-5 to be a 6-fold interpenetrated pts topology. Interestingly, FCOF-5 is flexible and can undergo reversible expansion/contraction upon vapor adsorption/desorption, indicating a breathing motion. Moreover, a smart soft polymer composite film with FCOF-5 was fabricated, which can show a reversible vapor-triggered shape transformation. Therefore, 3D COFs constructed from flexible building blocks can exhibit interesting breathing behavior, and finally, a totally new type of soft porous crystals made of pure organic framework was announced.