Software engineering has been driven over decades by the trend towards component based development and loose coupling. Service oriented architectures and Web Services in particular are the latest product of this long-reaching development. Semantic Web Services (SWS) apply the paradigms of the Semantic Web to Web Services to allow more flexible and dynamic service usages. Numerous frameworks to realize SWS have been put forward in recent years but their relative advantages and general maturity are not easy to assess. This dissertation presents a solution to this issue. It defines a general methodology and framework for SWS technology evaluation as well as concrete benchmarks to assess the functional scope and performance of various approaches. The presented benchmarks have been executed within international evaluation campaign. The thesis thus comprehensively covers theoretical, methodological as well as practical results regarding the evaluation and assessment of SWS technologies.