EF Fluent API for hierarchical data

Question

I want to store hierarchical data in the database and need help how to configure the model. There is also a set of hierarchical data per user. After the data has been stored in the database, it is changed very rarely.

The database, I plan to use are as follows:

User
    Id          int


TreeEntity
    Id          int
    UserId      int
    ParentId    int

TreeEntity.UserId reference to User.Id TreeEntity.ParentId reference to TreeEntity.Id. If ParentId is unset, it is the root in the tree.

I've thought about trying to configure EF so that the data is mapped to the following classes

User
    // All TreeEntity that have TreeEntity.UserId==User.Id
    // Desirable, but not necessary
    //   ICollection<TreeEntity>        AllEntitiesForUser{get; set;}

    // The roots of the tree for this User. 
    // All TreeEntity that have TreeEntity.UserId==User.Id and TreeEntity.Parent==0
    ICollection<TreeEntity>     Tree {get;set;}

TreeEntity
    // Reference to the User 
    User                        User {get;set;}
    // Reference to the parent
    TreeEntity                  Parent {get;set;}
    // List of all children
    ICollection<TreeEntity>     Children {get;set;}

What I have succeeded so far are as follows

modelBuilder.Entity<User>()
    .HasMany(d => d.Tree)
    .WithRequired(d => d.User);

modelBuilder.Entity<TreeEntity>()
    .HasMany(d => d.Children)
    .WithOptional(d => d.Parent);

This is obviously not correct, but I do not really know how I should proceed. If that's even possible?