Compilation not supporting packages

Is it as-intended that the dynamic compilation of java files do not support subfulders (ie. packages) in the sources folder?

Apparently everything is flattened, so I can't use packages in dynamic compilation, as far as I can see.