All bonds carry a risk of default, which means that it's possible that you can lose your principal investment in addition to potentially not getting the interest payments that you expect. Bonds (in the US anyway) are graded, so you can manage this risk somewhat by taking higher quality bonds, i.e. in companies or governments that are considered more creditworthy.
Regular bank savings (again specific to the US) are insured by FDIC, so even if your bank goes bust, the US Government is backing them up to some limit. That makes such accounts less risky. There's generally no insurance on a bond, even if it is issued by a government entity.
If you do your homework on the bond rating system and choose bonds in a rating band where you're comfortable, this could be a good option for you. You'll find, however, that the bond market also "knows" that the interest rates are generally low, so be ware that higher interest issues are usually coming from less creditworthy (and therefore more risky) issuers.
EDIT
Here's some additional information based on the follow-up question in the comment. When you buy a bond you are actually making a loan to the issuer. They will pay you interest over the lifetime of the bond and then return your principal at the end of the term. (Verify this payment schedule - This is typical, but you should be sure that whatever you're buying works like this.)
This is not an investment in the value of the issuer itself like you would be making if you bought stock. With stock you are taking an ownership share in the company. This might entitle you to dividends if the company pays them, but otherwise your investment value on a stock will be tied to the performance of the company. With the bond, the company might be in decline but the bond still a good investment so long as the company doesn't decline so much that they cannot pay their debts.
Also, bonds can be issued by governments, but governments do not sell stock. (An "ownership share of the government" would not make sense.) This may be the so-called sovereign debt if issued by a sovereign government or it may be local (we call it municipal here in the US) debt issued by a subordinate level of government.
Bonds are a little bit like stock in the sense that there's a secondary market for them. That means that if you get partway through the length of the bond and don't want to hold it, you can sell the bond to someone else. Of course, it will be harder to sell a bond later if the company becomes insolvent or if the interest rates go up between when you buy and when you sell. Depending on these market factors, you might end up with a capital gain or capital loss (meaning you get more or less than the principal that you put into the bond) at the time of a sale.
