Agreed. Mobility and structural elements combine poorly.
Far better reliability and use of space would be to provide a standard structure, insulated against winter, with flexible shades and blinds, and then use the additional space to provide patio or porch space which could be opened more fully or closed in given precipitation, sun, and/or weather.
First time you forget to close up the house before a surprise snowstorm will be a memory for the ages...