You would become a debtor, not a creditor - you owe them money. However, unless you have an overdraft or other at-call type loan, your loan would be a contract requiring repayment over a defined term - typically 25 to 30 years. Unless you default, and give the cause to have the total immediately payable, then you just keep making your payments to the administrator/receiver/liquidator.
You may have a problem and want to refinance if the interest rate is variable, and goes to an uncompetitive rate, but there are protections which should prevent that in any event.
You would have much more to worry about if you were actually a creditor - and had money on deposit. In Australia, that is not too much of a concern, as the Bank deposit holders have first call on the assets of the bank - ahead of even secured creditors, in the event of a collapse. With the Reserve Bank acting as lender of last resort, in effect (and despite the hysteria about no Government guarantee of deposits), the worst case scenario would be a bank in trouble being forced to borrow from the RBA to repay depositors - who would rank ahead of the RBA.
Of course, if you are talking about a Non-Bank Financial Institution (Credit Union, Building Society etc), then the above does not apply.