Typically 10-15 feet in height, taller than wide

Hardwood hammocks

Buffer plantings, rarely used as landscape shrub

Leaf has three distinct/fully separated leaflets

Spicewood (Calyptranthes pallens)
Similar features: Overall size, growth form and typical locations
Distinguished by: torchwood has compound leaves with three leaflets

White ironwood (Hypelate trifoliata)
Similar features:  Overall size, growth form, typical locations,  compound leaves with  three leaflets
Distinguished by: white ironwood leaflet shape is oval, spicewood leaflet shape is deltoid

External links: 

Institute for Regional Conservation:
https://www.regionalconservation.org/beta/nfyn/plantdetail.asp?tx=Amyrelem