Hello to everyone.


What the question means is that different ways of 
expressing the same relation between the data and unknown variables produce
really weird fit results:


The problem:
I have the unknown variables $x\_1,x\_2,x\_3,x\_4,x\_5,x\_6$
and the observations $\vec{q}\_i=\Big(q\_i(1),q\_i(2),q\_i(3)\Big), i=1\ldots N$  

($N$ observations of real valued 3-vectors)


The relation between the unknowns and the observations is:


$\vec{q}\_i\cdot(x\_1,x\_3,x\_5)^T=-1$ (1st Set of $N$ equations)  

$\vec{q}\_i\cdot(x\_2,x\_4,x\_6)^T=3$ (2nd Set of $N$ equations)


If i solve each set of equations as a separate overdetermined linear system
the solution error is very bad.


But if i exploit that $3=(-3)\*(-1)$ and combine the 2 previous Equations into one equation


$\vec{q}\_i\cdot(x\_2,x\_4,x\_6)^T=-3\ \vec{q}\_i\cdot(x\_1,x\_3,x\_5)^T$ 


This is a relation between the observations
and the unknowns that results in the following overdetermined homogeneous system:


$3q\_i(1)x\_1+q\_i(1)x\_2+3q\_i(2)x\_3+q\_i(2)x\_4+3q\_i(3)x\_5+q\_i(3)x\_6=0,\ \ \ \ \ i=1\ldots N$


I use MATLAB for calculations.  

Solving this for $x\_1,x\_2,x\_3,x\_4,x\_5,x\_6$ using SVD gives excellent fitting results and extremely low error.  

What is so bad about solving separately the two overdetermined linear systems?  

Are my variables correlated?  

What are some guidelines to be followed
when formulating overdetermined systems of equations? 


I have been frantically looking for answer on this one for days. 


EDIT: The homogeneous representation is the only one that is correct.
It turns out that the inhomogeneous representation using constants on the right
side for the equations is wrong. 


In my problem the equations are multiples of each other and *not* exact numbers.
That's why the fitting is successful with the homogeneous representation that
depends on the ratio. It fails otherwise. 


After noticing that the correct solution norm is bad for the inhomogeneous
equations i figured out the problem.



My overdetermined linear system gives both bad and good estimates. Why ?
In using least squares, you normally want the residuals from the various equations to be indpendent of each other. If your $q\_{i}$ vectors are imprecise measurements, then this will introduce correlation between the residuals in the pair of equations invovling $q\_{i}$. 


When you say that you get a "good fit" using the homoegneous system, how well does the solution satisfy the original nonhomogeneous system of equations? 


