Place the softened cream cheese, brown sugar, granulated sugar, and vanilla extract in a medium mixing bowl.
Beat the mixture using an electric hand mixer on medium speed until the texture is smooth and the sugars are well incorporated.
Transfer the cream cheese base to a shallow serving dish and spread it into an even layer using an offset spatula.
Pour the caramel sauce over the cream cheese layer, spreading it gently to the edges.
Sprinkle the flaky sea salt and toffee bits uniformly over the surface of the caramel.
Serve immediately with fresh apple slices or cover and refrigerate until chilled.