It is convenient to use the inelastic displacement ratio spectra and residual displacement ratio spectra to predict the maximum inelastic displacement and residual displacement of building structures based on linear elastic analysis directly. The prestressed concrete wall system with friction devices (PCW-FD system) can be simulated by single-degree-of-freedom (SDOF) model with self-centering behavior. To investigate the seismic performance of PCW-FD system, the SDOF models with fully and non-fully self-centering behavior are analyzed firstly, and it is concluded that the hysteresis parameters (strength reduction coefficient, post-yield stiffness coefficient, energy dissipation coefficient, and period) have significant influence on the seismic responses (such as constant relative strength inelastic displacement ratio, constant relative strength residual displacement ratio, maximum absolute acceleration, the hysteretic energy, and site classifications) during short period, and the trends of the seismic responses are similar at different site classifications. Then a large amount of the result data is summarized, and the constant relative strength inelastic displacement ratio spectra and the constant relative strength residual displacement ratio spectra with enough precision (the correlation coefficients are 0.957 and 0.947, respectively) are established by conducting regression analysis. Finally, the direct displacement–based seismic design method is improved and verified to be suitable for PCW-FD system.