How To Record These Investment Transactions?

When you do a Sell transaction, the sale will create cash, and the difference between the purchase price and the sale price is the gain or loss. There is no transaction recorded for the gain/loss, but Quicken calculates it internally when you run a report. Gains are taxable income; if the sale is of shares you held for less than a year, it's called a short-term gain and is taxable like your regular income; if the shares have been held for more than a year, it's a long-term capital gain which is taxable at a lower rate. (Losses subtract from your gains, reducing the taxable amount.)

That all said, this transaction is in a retirement account. Gains in retirement accounts, whether from dividends or capital gains, are not taxable. You get taxed when you eventually withdraw money from the 401k or IRA in retirement. Quicken knows this, and doesn't calculate capital gains/losses on sales of shares in retirement accounts. And that's why Jon said it doesn't really matter how you record the removal of shares.

Personally, I would record the sale, generating cash, and then record a Payment/Deposit transaction to remove the cash and categorize it as an investment fee. This gives you a more accurate picture of what actually happened, and because you've categorize the expense, you can see how much you've incurred in charges at the end of the year.