Tax-Exempt line items on PO

Some line items on a PO need to be tax-exempt (ex: admin fees) but it is not possible to choose which line items are to be taxed. It can be done in an invoice but when choosing "create PO from invoice", it will not allow the line item to transfer because there is no vendor.