A Fresnel-type self-interference based incoherent digital holographic system that can measure the intensity and direction of incoming light field is proposed. This system is composed primarily of a convex lens as an objective, a linear polarizer, a fluorescence bandpass filter, a Geometric-Phase (GP) lens, a relay lens and a monochromatic polarized camera. The GP lens is employed as a polarization selective common path interferometer. It simultaneously modulates the incoming wavefront by its positive and negative focal lengths. The wavefront modulation and phase shifting are performed purely by the geometric phase modulation. The parallel-phase shifting method is utilized to obtain a single complex hologram by using a monochromatic polarized image sensor. With the generated hologram, it is possible to digitally reconstruct images by focusing to different planes. A modified Angular Spectrum (AS) algorithm enables an accurate and efficient wavefield propagation for reconstruction of the holograms. The system parameters for the modified Geometric Phase-Self interference Incoherent Digital Holography (GP-SIDH) architecture are analyzed and evaluated to characterize the bounds for optimum reconstruction results based on a given set of criterion.