Get-PublicFolderDatabase -server SBS2008 | Remove-PublicFolderDatabase Remove-PublicFolderDatabase : The public folder database "SBS2008\Second Storage Group\Public Folder Database" contains folder replicas. Before deleting the public folder database, remove the folders or move the replicas to another public folder database. For detailed instructions about how to remove a public folder database, see http://go.microsoft.com/fwlink/?linkid=81409.

Resolving:

Opened up the Configuration portion of my domain  Went to CN=Services --> CN=Microsoft Exchange --> CN="my domain" --> CN=Administrative Groups --> CN=Exchange Administrative Group --> CN=Servers --> CN="my server name" --> CN=InformationStore

Delete the Public Folder Entrance.