I understand what you're saying, however I believe you're completely backward in the two types . . .
INFPs care deeply for a select group of people
INFJs care for for the good of everyone around them
The most striking thing about Fi is it's ability to order and prioritize people. If you've made it close to the top of an Fi user's list of people, there will be a specific reason for it, and if the Fi user doesn't have a connection with you, then you won't matter much to them.
Fe doesn't do that, it has an odd way of letting everyone else order themselves by pushing their way to the front.
Imagine an INFP as living in a "sky scraper of feeling". They can invite people to whatever floor they want them to be on, and move them around freely. They can listen to one person at a time and focus on them while sending others to a different floor. They also have the ability to escape to the top floor so that they can prioritize themselves for a while.
An INFJ lives in a "warehouse of feeling". . . Usually hiding in a corner trying not to get overwhelmed by everyone around them who seem to be shouting their feelings out loud. There are no places to escape to, they can only try to cover their ears.
B
I agree with the 'logic' or 'flow' of Fi vs Fe that you have mentioned, but I fail to see how it invalidates what I've said. One point of contention I have is that while Fe may work that way, in and of itself, the combination of other functions does not allow it to always work that way. Also, the behaviours that you have have described I have seen more commonly in ENFPs and ExFJs than in INFPs and IxFJs.