Camera networks are important in a video surveillance system. Many surveillance systems research has been done; most of it utilizes a general purpose computer. However, the latest trend is to use small, task specific and low power computer to process and control the system; in another word using embedded systems. This paper presents a camera network localization algorithm to be implemented on a FPGA device. An algorithm that uses object image tracking to determine cameras' locations is used. For tracking moving objects, there are a lot of techniques available. We used Adaptive Hybrid deference Algorithm for tracking objects, simulate it and study its feasibility. A hardware design is needed before programming the FPGA. We have developed a hardware design model; which is currently under testing and simulation.