Stated in other words, they are proving that any system's solution set differs from the corresponding homogenous system's solution set only by the particular solution.
It is a bit confusing, because in the Lemma, \(\overrightarrow{h}\) is assumed to be a set of 1. I am not using \(\overrightarrow{s}\) and \(\overrightarrow{h}\) in the same way as the proof. \(\overrightarrow{s}\) and \(\overrightarrow{h}\) represent sets with \(i\) solutions.
Part I. From Appendix A-5, if two sets have the same members, they are equivalent. For set inclusion the first way (\(\overrightarrow{s}_i \in \overrightarrow{p} + \overrightarrow{h}\)).
In this case, for any solution in \(\overrightarrow{s}\), \(\overrightarrow{s}_i - \overrightarrow{p}\) gives \(\overrightarrow{0}\), just as any solution of the associated homogenous system \(\overrightarrow{h_i}\) gives \(\overrightarrow{0}\) (i.e. the particular solution of any homogenous system is \(\overrightarrow{0}\)).
Part II. Likewise, for set inclusion the second way (\( \overrightarrow{p} + \overrightarrow{h}_i \in \overrightarrow{s}\)): any solution of the solution set of the associated homogenous system plus the particular solution of the system is sufficient to solve any system. By definition \(\overrightarrow{h}_i\) always gives \(\overrightarrow{0}\), but adding \(\overrightarrow{p}\) will give the complete solution set because in the first part of the proof they showed that \(\overrightarrow{s}_i - \overrightarrow{p} = \overrightarrow{h}_i.\).
Thus, we can use the solution set of an associated homogenous system to get the solution set of any system (if we have the particular solution).
The other lemma proved that any homogenous system could be expressed in the pattern: particular + unrestricted combination. Combining that lemma with this one shows that any system can be expressed in that pattern because you only need to add the particular solution to get an equivalent solution set. However, they do not show this proof.