The platform neutrality of Java programs allows them to run on heterogeneous computers. In the distributed environment, however, Java programs often cause performance problem because they are not implemented for specific clients so that they may conflict with their usage patterns at the client side. In this paper, we present a mechanism to address this problem by optimizing Java programs using program specialization technique. Unlike traditional program specialization, our specialization method does not encode the result of specialization only into run-time code. Instead, it encodes the values of multi-valued static expressions into indexed data structure that is referenced by run-time code, and single-valued static expressions into run-time code. With this approach, we can address the code explosion problem of traditional program specialization. With preliminary implementation, we achieved improvement in performance up to a factor of 9 with very low memory and space requirements and overheads.