I am currently researching the options that are available (both Open Source and Commercial) for developing a distributed application.
"A distributed system consists of multiple autonomous computers that communicate through a computer network." Wikipedia
The application is focused on distributing highly cpu intensive operations (as opposed to data intensive) so I'm sure MapReduce solutions don't fit the bill.
Any framework that you can recommend ( + give a brief summary of any experience or comparison to other frameworks ) would be greatly appreciated.
Azure Grid - http://azuregrid.codeplex.com/
DryadLINQ is a Microsoft Research project to allow LINQ queries to be distributed among multiple computers, rather than just multiple cores as Parallel LINQ does.
Blog post with a brief example.